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A BC Note 


Students learn in a number of ways and in a variety of setings. They learn 
through lectures, in informal study groups, or alone at their desks or in tront of 
a computer terminal. Wherever the location, students learn most efficiently by 
solving problems, with frequent feedback from an instructor, following a worked- 
out problem as a model. Worked-out problems have a number of positive as- 
pects. They can capture the essence of a key concept—often better than para- 
graphs of explanation. They provide methods for acquiring new knowledge 
and for evaluating its use. They provide a taste of real-tife issues and demon- 
strate techniques for solving real problems. Most important, they encourage 
active participation in learning. 

We created the BookWare Companion Series because we saw an unful- 
tilled need for computer-based learning tools that address the computational 
aspects of problem solving across the curriculum. The BC series concept was 
also shaped by other forces: a general agreement among instructors that stu- 
denis learn best when they are actively involved in their own learning, and the 
realization that textbooks have not kept up with or matched student learning 
needs. Educators and publishers are just beginning to understand that the amount 
of material crammed into most textbooks cannot be absorbed, let alone the 
knowledge to be mastered in four years of undergraduate study. Rather than 
attempting to teach students all the latest knowledge, colleges and universittics 
are now striving to teach them to reason: to understand the relationships and 
connections between new information and existing knowlege; and to cultivate 
problem-solving skills, intuition, and critical thinking. The BookWare Com- 
panion Series was developed in response to this changing mission. 

Specifically, the Book Ware Companion Series was designed for educators 
who wish to integrate their curriculum with computer-based learning tools, and 
for students who find their current textbooks overwhelming. The former will 
find in the BookWare Companion Series the means by which to use powerful 
software tools to support their course activities, without having to customize 
the applications themselves. The latter will find relevant problems and examples 
quickly and easily and have instant electronic access to them. 

We hope that the BC series will become a clearinghouse for the exchange 
of reliable teaching ideas and a baseline series for incorporating learning ad- 
vances from emerging technologies. For example, we intend toreuse the kernel 
of each BC volume and add electronic scripts from other software programs as 
desired by customers. We are pursuing the addition of AVExpert System tech- 
nology to provide and intelligent tutoring capability for future iterations of BC 
volumes. We also anticipate a paperless environment in which BC content can 








flow freely over high-speed networks to support remote learning activities. In order 
for these and other goals to be realized, educators. students. software developers. 
network administrators, and publishers will need to communicate freely and actively 
with each other. We encourage you to participate in these exciting developments and 
become involved in the BC Series today. If you have an idea for improving the effec- 
tiveness of the BC concept, an example problem, a demonstration using software or 
multimedia, or an opportunity to explore, contact us. 
We thank you one and all for your continuing support. 


The PWS Electrical Engineering Team: 
BBarter@pws.com — Acquisitions Editor 
SJeans @pws.com Assistant Editor 
NWilbur@pws.com Marketing Manager 
PRockwell@ pws.com Production Editor 


TKelly @pws.com Editorial Assistant 
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PREFACE 


There are many textbooks on the market today that treat the basic topics in analog and 
digital communication systems, including coding and decoding algorithms and modulation 
and demodulation techniques. The tocus of most of these textbooks is by necessity on the 
theory that underlies the design and performance analysis of the various building blocks, 
e.g., coders, decoders, modulators, and demodulators, that constitute the basic elements of 
a communication system. Relatively few of the textbooks, especially those written for un- 
dergraduate students, include a number of applications that serve to motivate the students. 


SCOPE OF THE BOOK 


The objective of this book is to serve as a companion or supplement, to any of the com- 
prehensive textbooks in communication systems. The book provides a variety of exercises 
that may be solved on the computer (generally. a personal computer is sufficient) using 
the popular student edition of MATLAB. The book is intended to be used primarily by 
senior-level undergraduate students and graduate students in electrical engineering, com- 
puter engineering and computer science. We assume that the student (or user) is familiar 
with the fundamentals of MATLAB. Those topics are not covered, because several tutorial 
books and manuals on MATLAB are available. 


By design, the treatment of the various topics is brief. We provide the motivation and 
a short introduction to each topic, establish the necessary notation, and then illustrate the 
basic notions by means of an example. The primary text and the instructor are expected to 
provide the required depth of the topics treated. For example, we introduce the matched 
filter and the correlator and assert that these devices result in the optimum demodulation 
of signals corrupted by additive white Gaussian noise (AWGN), but we do not provide a 
proof of this assertion. Such a proof is generally given in most textbooks on communication 
systems. 


ORGANIZATION OF THE BOOK 


The book consists of nine chapters. The first iwo chapters on signals and linear systems and 
on random processes treakthe basic background that is generally required in the study of 
communication systems. There is one chapter on analog communication techniques, and 
the remaining five chapters are focused on digital communications. 


Chapter 1: Signals and Linear Systems 


This chapter provides a review of the basic tools and techniques from linear systems analysis, 
including both time-domain and frequency-domain characterizations. Frequency-domain- 
analysis techniques are emphasized, since these techniques are most frequently used in the 
treatment of communication systems. 


xi 
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Chapter 2: Random Processes 


fn this chapter we illustrate methods far nerating random variables and samples of ran- 
dom processes. The topics include the generation of random variables with a specified 
probability distribution function, the generation of samples of Gaussian and Gauss-Markov 
Processes, and the characterization of stationary random processes in the time domain and 
the frequency domain 











Chapter 3: Analog Modulation 


The performances of analog modulation and demodulation techniques in the presence and 
absence of additive noise are treated in this chapter. Systems studied include amplitude 
modulation (AM), such as double-sideband AM. single-sideband AM, and conventional 
AM, and angte-mouutation schemes, such as frequency modulation (FM) and phase mod- 
ulation (PM). 


Chapter 4: Analog-to-Digital Conversion 


Tn this chapter we treat various methods that are used to convert analog source signals into 
digital sequences in an efficient way. This conversion process allows us to transmit or store 
the signals digitally. We consider both lossy data compression schemes, such as pulse-code 
modulation (PCM), and lossless data compression, such as Huffman coding. 


Chapter 5: Baseband Digital Transmission 


The focus of this chapter is on the introduction of baseband digital modulation and demod- 
ulation techniques for transmitting digital information through an AWGN channel. Both 
binary and nonbinary modulation techniques are considered. The optimum demodulation 
of these signals is described, and the performance of the demodulator is evaluated. 


Chapter 6: Digital Transmission Through Bandlimited Channels 


In this chapter we consider the characterization of bandlimited channels and the problem of 
designing signal waveforms for such channels. We show that channel distortion results in 
intersymbol interference (ISI), which causes errors in signal demodulation. Then, we treat 
the design of channel equalizers that compensate for channel distortion. 


Chapter 7: Digital Transmission via Carrier Modulation 


Four types of carrier-modulated signals that are suitable for transmission through bandpass 
channels are considered in this chapter. These are amplitude-modulated signals, quadrature- 
amplitude-modulated signats, phase-shitt keying, and frequency-shift keying. 


Chapter 8: Channel Capacity and Coding 


In this chapter we consider appropriate mathematical models for communication channels 
and introduce a fundamental quantity, called the channel capacity. that gives the limit on 
the amount of information that can be transmitted through the channel. In particular, we 
consider two channel models, the binary symmetric channel (BSC) and the additive white 


xiii 


Gaussian noise (AWGN) channel. These channet models are used in the treatment of block 
and convolutional codes for achieving reliable communication through such channels. 


Chapter 9: Spread Spectrum Communication Systems F 


The basic elements of a spread spectrum digital communication system are treated in this 
chapter. In particular, direct sequence (DS) spread spectrum and frequency-hopped (FH) 
spread spectrum systems are considered in conjunction with phase-shift keying (PSK) and 
frequency-shift keying (FSK) modulation, respectively. The generation of pseudonoise 
(PN) sequences for use in spread spectrum systems is also treated. 


SOFTWARE 


The accompanying diskette includes all the MATLAB files used in the text. The files are in 
separate directories corresponding to each chapter of the book. In some cases a MATLAB 
file appears in more than one directory because it is used in more than one chapter, In most 
cases numerous comments have been added to the MATLAB files to ease their understand- 
ing. It should be noted, however, that in developing the MATLAB files, the main objective 
of the authors has been the clarity of the MATLAB code rather than its efficiency. In cases 
where efficient code could have made it difficult to follow, we have chosen to use a less 
efficient but more readable code. 

In order to use the software, copy the MATLAB files to your personal computer and add 
the corresponding paths to your mat labpath environment (on an IBM PC compatible 
machine this is usually done by editing the matlabre.m file). All MATLAB files have been 
tested using version 4 of MATLAB. 


Chapter 1 


Signals and Linear Systems 


1.1 Preview 


In this chapter we review the basic tools and techniques from linear system analysis used 
in the analysis of communication systems. Linear systems and their characteristics in the 
time and frequency domains, together with probability and analysis of random signals, are 
the two fundamental topics whose thorough understanding is indispensable in the study 
of communication systems. Most communication channels and many subblocks of trans- 
mitters and receivers can be well modeled as finear and time-invariant (LTT) systems, and 
so the well-known tools and techniques from linear system analysis can be employed in 
their analysis. We emphasize frequency-domain analysis tools, since these are the most 
frequently used techniques. We start with the Fourier series and transforms; then we cover 
power and energy concepts. the sampling theorem, and lowpass representation of bandpass 
signals. 


1.2 Fourier Series 


The input-output relation of a linear time-invariant system is given by the convolution 
integral defined by 


y) = x(t) # A(t) (1.2.1) 


æ 
=f A(r)x(t —t)dt 
-æ 


where A(t) denotes the impulse response of the system, x(t) is the input signal, and y(s) is 
the output signal. If the input x(r) is a complex exponential given by 


x(t) = AeA (1.2.2) 





w 


CHAPTER i. SIGNALS AND LINEAR SYSTEMS 


then the output is given by 


0 
=f Ael*I0-O ne) de 


o0 


œ 
=A [f h(t) e7477 ar] eiai (1.2.3) 


-00 


In other words, the output is a complex exponential with the same frequency as the input. 
The (complex) amplitude of the output, however, is the (complex) amplitude of the input 
amplified by 


20 4l 
f h(r)e i dr 


o0 


Note that the above quantity is a function of the impulse response of the LTI system, A(1), and 
the frequency of the input signal, fo. Therefore, computing the response of LTI systems to 
exponential inputs is particularly easy. Consequently, it is natural in linear system analysis 
to look for methods of expanding signals as the sum of complex exponentials. Fourier 
series and Fourier transforms are techniques for expanding signals in terms of complex 
exponentials. 

A Fourier series is the orthogonal expansion of Periodic signals with period Ty when 
the signal set {e/2""!/Ti)" is employed as the basis for the expansion. With this basis, 
any periodic signal! x(t) with period To can be expressed as 


20 
(= J xpe 0.2.4) 


n=-00 


where the x's are called the Fourier series coefficients of the signal x(t) and are given by 


1 a+To 
in = zS x(t)e 77T de (1.2.5) 
a 


Here a is an arbitrary constant chosen in such a way that the computation of the integral is 
simplified. The frequency fy = 1/To is called the fundamental frequency of the periodic 
signal, and the frequency fn = nfo is called the nth harmonic. In most cases either œ = 0 
or œ = —To/2 is a good choice. 

This type of Fourier series is known as the exponential Fourier series and can be applied 
to both real-valued and complex-valued signals x(t) as long as they are periodic. In general, 
the Fourier series coefficients {x,} are complex numbers even when x(t) is a real-valued 
signal, 








1 A sufficient condition for the existence of the Fourier series is that x(t) satisfy the Dirichlet conditions. For 
details see [1]. 
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When x(t) is a real-valued periodic signal we have 
1 ero 
To Ja 


pu Tn a x; 
| neha] 


a 





ton = xie iT gy 


ae] 
TL 
ac (1.2.6) 


From this it is obvious that 


(1.2.7) 





Thus the Fourier scries coefficients of a real-valued signal have Hermitian symmetry; i.e.. 
their real part is even and their imaginary part is odd {or, equivalently. their magnitude is 
even and their phase is odd). 
Another form of Fourier series, known as trigonometric Fourier series, can be applied 
only to real, periodic signals and is obtained by detining 
an ~ by 
2 
— dnt jbn 


x 
i 
i 
i 
2 


2 


which, after using Euler's relation 





n 
emin = cos (ut = jsin (2012) (1.2.10) 
results in 
2 fa-me rs 
== (Dcos | 2x¢— } de 
meer Soma ( z) 
2 pach n 
bn = = Hsin | 2%1— } de 1.2.14 
w= h coin ( 5) ( ) 
and, therefore, 
a al n n 
x(t) = F +D ascos (25:2) + by sin (=£) (1.2.12) 


n=l 


Note that for n = 0 we always have bg = 0, so ag = 2x9. 
By defining 





Cn = yato 
(1.2.13) 


b, 
Ən = — arctan — 
ay 
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and using the relation 
x ETE b 
acoso + bsing = Var + bcos | @ — arctan — (1.2.14) 
aj 


Equation (1.2.12) can be written in the form 


“w, Š n 
sin = z+ Cn COS dat + Oy (1.2.15) 


asl 


which is the third torm of the Fourier series expansion for real and periodic signals. In 
general the Fourier series coefficients {x4} for real-valued signals are related (0 ay, Bn, Cn, 
and Pa through 


un = 2Re[x,] 


by, = —2Im[x, 

7 [xa] (1.2.16) 
On = Wal 

On = Ln 


Plots of [e| and 2x, versus # or nfo are called the discrere spectrum of x(t). The plot of 
krat is usually called the magsitude spectrum, and the plot of 2x, is referred to as the phase 
Spectrum. 


If x(t) is real and even—1.e..if x(—t) = «(1)—then taking @ = —To/2, we have 
2 [PeP n 
hy = => xir sin (20:2) dt 1.2.17 
Tp io To ‘ 


which is zero because the integrand is an odd function of r. Therefore. for a real and even 
signal x(t). all x„’s are real. In this case the trigonometric Fourier series consists of all 





cosine functions. Similarly, if ¢(2) is real and odd—i-e., if x(—1) = —x(¢)—then 
2 atta a 
== x(t) cos am) dt 1.2.18) 
a Tola s( To ) 


is zero and all x's are imaginary. In this case the trigonometric Fourier series consists of 
all sine functi 


ILLUSTRATIVE PROBLEM 


INustrative Problem 1.1 [Fourier series of a rectangular signal train] Let the periodic 
signal x(r), with period Tp, be defined by 





A It] < to 
t A 
4 =A —)=)-. = 1.2.19) 
x(t) n(z-) 2 t= to ( ) 
0, otherwise 
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for jt! < To/2. where to < To/2. The rectangular signal T(t) is, as usual, defined by 





ko HRES 
M(t) = 45. t=} (1.2.20) 
0. otherwise 
A plot of x(r) is shown in Figure 1.1. 
jo 
[A 
; j | f 
| Ta t Tu 
meres 
-To p ] 19 To mr 


Figure 1.1: The signal x(t). in Illustrative Problem t.1. 


Assuming A = 1. Ty = 4, and to = 1: 


1. Determine the Fourier series coefficients of x(t) in exponential and trigonometric 
form. 


2. Plot the discrete spectrum of x(¢). 


em SOLUTION 





1. To derive the Fourier series coefficients in the expansion of x(t), we have 


i i 
Xe emim gy 
tio 


It 
j 





> =j2an/4 _ ,jdmn/a 
=z [e eent] (1.2.21) 
l n 
= qsine (5) (1.2.22) 
where sinc(x) is defined as 
sinc(x) = may (1.2.23) 
nx 


A plot of the sinc function is shown in Figure 1.2. 
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Figure 1.2: The sinc signal. 
Obviously, all the x„'s are real (since x(t) is real and even), so 
Figure 1.3: Various Fourier series approximations for the rectangular pulse in Illustrative 
n 
= sine {— Problem 1.1. 
an = sine (2) 
by = 0 os 
n (1.2.24) f 7 
-be 5 | 
i 
1 = 0.7 : gil 
Note that for even n's, xn = 0 (with the exception of n = 0, where ag = co = land oe 
Xo = 4), Using these coefficients we have z o i 
i 
os ji ! 
i n 2 g 
= te RN ganya 
x(t)= > xsine (3) e A ak 
n=% 
1 S n n on 
= 5 + Desinc (5) cos (2707) (1.2.25) 


A plot of the Fourier series approximations to this signal over one period forn = 
0, 1, 3,5,7,9 is shown in Figure 1.3. Note that as n increases, the approximation 
becomes closer to the original signal x(¢). 














- Note that x, is always real. Therefore. depending on its sign, the phase is either zero 
or x. The magnitude of the x,’s is 4 |sine (3) . The discrete spectrum is shown in 
Figure 1.4. 


Figure 1.4: The discrete spectrum of the signal in Hlustrative Problem 1.1, 
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The MATLAB script for plotting the discrete spectrum of the signal is given below 








% MATLAB script for Mlustrative Problem 1, Chapter 1 
~20:1:20); 

=abs(sinc(n/2)); 

stem(a,x); 








When the signal x(t) is described on one period between a and b, as shown in Figure 
1.5, and the signal in the interval [a, b] is given in an m-file, the Fourier series coefficients 
can be obtained using the m-file fseries.m given below 





function xx=fseries(funfcn,a,b,n,tol,p,p2,p3) 

%FSERIES Returns the Fourier series coefficients. 

XX = FSERIES(FUNFCN.A.B.N.TOL,P1,P2,P3} 
Junfen = The given function, in an m-file. 

Tt can depend un up to three parameters 

pl, p2. and p3. The function is given 

over ane perind extending from ‘a’ ta ‘b° 

xx = vector of length n + 1 of Fourier Series 
Coefficients, x40, xk. xxn 

pl. p2. p3 = parameters of funfen 

tol = the error level 


APRAKRRAas 


Jesqr(—1); 

args={ ]; 

for nn=t:nargin—5 
args=[args,’ , p’ ine2str(nn)}; 





newfun=[’ exp (-j*2*pitx? (+ .int2str(i)."} / t° mum2ste(e),”)} .* * fanfen}. 
xx(i+Teeval({’ 1/ (' num@str(t),’}. ‘quad (newfun,a,b, tol. í |" args)): 
end 





ILLUSTRATIVE PROBLEM 


Dlustrative Problem 1.2 [The magnitude and the phase spectra] Determine and plot 
the discrete magnitude and phase spectra of the periodic signal x(t) with a period equal to 
8 and defined as x(t) = A(t) for |t| < 4. 


Ei — 


Since the signal is given by an m-file lambda.m, we can choose the interval {a, b] = 
[—4, 4] and determine the coefficients. Note that the m-file fseries.m determines the Fourier 
series coefficients for nonnegative values of n, but since here x(t) is real-valued, we have 
Xun = x4. In Figure 1.6 the magnitude and the phase spectra of this signal are plotted for 
a choice of n = 24. 
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Figure 1.5: A periodic signal, 


The MATLAB script for determining and plotting the magnitude and the phase spectra 
is given below. 


ee 





% MATLAB script for lilustrative Problem 2, Chapter 1 
echo on 





xx=fseries(function.a.b.n.tol} 

xxl=xx(nt1:—1:2); 

xx1=[conj(xx1).xx]: 

absxx L=abs(xxi): 

pause % Press any key to see a plot of the magnitude spectrum 
nl=(—n:a): 

stem(nl absxx$) 

tille(“ che discrete magnitude spectrum’) 
phasexx|=angle(xx1); 

pause % Press any key to see a plor of the phase 
stem(nlphasexx1) 

ütle(’ the discrete phase spectrum’) 





ILLUSTRATIVE PROBLEM 


Ulustrative Problem 1.3 [The magnitude and the phase spectra] Determine and plot 
the magnitude and the phase spectra of a periodic signal with a period equal to 12 that is 
given by 





in the interval [—6, 6]. A plot of this signal is shown in Figure 1.7. 
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Figure 1.6: The magnitude and the phase spectra in Illustrative Problem 1.2. 
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Figure 1.7: The periodic signal in Illustrative Problem 1.3. 





—_S2niip- 


The signal is equal to the density function of a zero-mean unit-variance Gaussian (nor- 
mat) random variable given in the m-file normal.m. This file requires two parameters, m 
and s, the mean and the standard deviation of the random variable, which in the above 
problem are O and 1, respectively. Therefore, we can use the following MATLAB script to 
obtain the magnitude and the phase plots shown in Figure 1.8. 








% MATLAB script for Iiustranve Problem 3, Chapter 1 
echo on 

function=‘ normal‘; 

a=-6; 

b=6: 

n=24; 

tol=0.1; 

xx=fseries(function.a.b,0,t01.0.1): 

xx l=xx(n41:-1:2); 
xx 1=(conj(xx).xx]; 

absxx | =abs(xx1); 

pause % Press any key to see a plot of the magnitude 
al=[-n:n]; 

stem(n]absxx1) 

title(* the discrete magnitude spectrum’) 
Phasexx] =angle(xx !); 

Pause % Press any key to see u plot of the phase 
stemni phasexx!) 

title’ the discrete phase spectrum’) 
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1.2.1 Periodic Signals and LTI Systems 


When a periodi nal x {r} is passed through a linear time-invariant (LTD system, as shown 
in Figure 1.9, the output signal yC!) is also periodic, usually with the same period as the 
input signal? (why?), and therefore it has a Fourier series expansion, 

If x(t) and y(t) are expanded as 





x 

x) = Fe mI (1.2.26) 
pe 
co 

yt) = > ype INT (1.2.27) 
nao 


then the relation between the Fourier series coefficients of x (r) and y(r) can be obtained by 
employing the convolution integral 


o 

=f x(t ~ r)h(r)dr 

-% 
x 


æ 
f So ane“) dr 


T% p=—00 


oa 


20 
2 Xn (J a(eye Pl as) ginni To 
-% 


n=- 


2 
Se ype tan (1.2.28) 
Tao 





a 


From the above relation we have 


n 
Yn = Xn H (2) (1.2.29) 


where H (f) denotes the transfer function? of the LTI system given as the Fourier transform 
of its impulse response A(t). 


co 
Hif) = f hei" dt (1.2.30) 


-00 





2We say usually with the same period as the input signal. Can you give an example where the period of the 
output is different from the period of the input? 
3 Also known as the frequency response of the system. 





£2. Fourier Serres 
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Figure 1.8: Magnitude and phase spectra for Illustrative Problem 1.3. 
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LTI System x9 1. We have 
1 opt? dents A 
“ce a rye iT di (1.2.33) 
Th J-nr 
Figure 1.9: Periodic signals through LTI systems. a a ER 
=> Í Aei dt (1.2.34) 
* Jet 
a Pas i 
ae -yan 
ILLUSTRATIVE PROBLEM “$ T. Ate a (12889) 
1 
Illustrative Problem 1.4 [Filtering of periodic signats) A triangular pulse train x {r} with = S FIA jen (1.2.36) 
period To = 2 is defined in one period as 1 ayn 
= ssine?(=) (1.2.37) 
ttl, -l<r<0 2 2 
A= f-rtl, O<r<t (1.2.31) where we have used the fact that \(¢) vanishes outside the {~1, 1} interval and that 
o LR the Fourier transform of A(r) is sinc?( f). This result can also be obtained by using 


the expression for A (r) and integrating by parts. Obviously, we have x, = 0 for all 


1. Determine the Fourier series coefficients of x (r). even values of n except for n = 0. 


2. Plot the discrete spectrum of x(t). 2. A plot of the discrete spectrum of x(1) is shown in Figure 1.11. 




















3. Assuming that this signal passes through an LTI system whose impulse response is f T “j 
given by ows f ! 
x tel $ o« 
maya fe OSE < (1.232) 
0, otherwise s os j! 
2 i 
1 
plot the discrete spectrum and the output y{r). Plots of x(t) and A(t) are given in at i 
Figure 1.10. i om 
x(t) A(t) i oz | i 
: f 
l iF- i ai i | 
i 
H oos 4 
=i ap ut 1 f : | : i 
$ Hl 
i O R 7 7 p $ g 7 
Figure 1.10: The input signal and the system impulse response. i 
| Figure 1.11: The discrete spectrum of the signal. 
i 


3. First we have to derive H (f). the transfer function of the system. Although this can 
be done analytically, we will adopt a numerical approach. The resulting magnitude 
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of the transfer function and also the magnitude of H(n/ To) = H(n/2) are shown in 
os 





Figure 1.12. 


4. To derive the discrete spectrum of the output we employ the relation 
sh 

° \ 

Ya =H | (1.2.38) i 


(1.2.39) 


1l 

i 

Hd 

3 

2 
— 

QI 
< 

x 

— 
RIZ 
WS 


The resulting discrete spectrum of the output is shown in Figure 1.13. | i 


The MATLAB script for this problem follows. 





% MATLAB script for Hlustrative Problem 4. Chapter 1 | iN 
echo on i \ 
n=(-20: 1:20]; 


% Fourier series coefficients of aft) vector i 

x=Sa(sine(n/2)).°2: Ss a 
% sumpling interval 

1551/40; 2 

% time vector Fiegibney 
t=[-.5:ts:1.5]; ge a F F 
% impulse response 

fs=1/ts; 
h=fzeros{1,20)1121:61).zeros(1,20)): 
% iransfer function 

Heffi(hy/fs, : | 
% frequency resolution 2 

df=fs/80; 
t={0:df:fs]-fs/2; 


% rearrange H 5 
Hl=ffishift(H); 
i 











os | 


oa} 





y=x.sH1(21:61); : o3 
% Plotting commands follow 5 F 








1.3 Fourier Transforms or i] 


| | 
J | | | | llin Ltt uiiviveceevvnntevacy m 


Fourier transform of a signal x(r) that satisfies certain conditions, known as Dirichlet’s 


The Fourier transform is the extension of the Fourier series to nonperiodic signals. The i i | 
conditions [1], is denoted by X(f) or, equivalently, F [x(1)] and is defined by 

















70 
Fix] = x= f x(t) de (1.3.1) 


-œ 


The inverse Fourier transform of X ( f) is x(t), given by Figure 1.12: The transfer function of the LTI system and the magnitude of H (3). 


M 
FAO = fT eag (132) 
Et 
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Figure 1.13: The discrete spectrum of the output. 


If x(t) is a real signal, then X ( f) satisfies the Hermitian symmetry, i.e., 
X(~f) = X*(f) (1.3.3) 


‘There are certain properties that the Fourier transform satisfies. The most important prop- 
erties of the Fourier transform are summarized as follows. 


1. Linearity: The Fourier transform of a linear combination of two or more signals is 
the linear combination of the corresponding Fourier transforms. 


F foexy (t) + Bx2(1)) = oF ix ()] + BF{x2()] (1.3.4) 
2. Duality: If X(f) = F(x(t)}, then 
F(X(t)} = x(-f) (13.5) 


3. Time shift: A shift in the time domain results in a phase shift in the frequency 
domain. If X(f} = F[x(t)], then 


F [x(t = to)) = e7} oX f) (1.3.6) 


4. Scaling: An expansion in the time domain results in a contraction in the frequency 
domain, and vice versa, If X(f) = F[x(r)], then 


1 f 
Faan = X (£). a#0 (1.3.7) 





Pp $a $$ a rr Shs 
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5. Modulation: Multiplication by an exponential in the time domain corresponds to a 
frequency shift in the frequency domain. If X(f) = F[x(s)], then 


Fiel) = XIF ~ fo) . 
(1.3.8) 


FEO cos(a fo] = IXS — fo) + XC + fo) 


6. Differentiation: Differentiation in the time domain corresponds to multiplication by 
J2af in the frequency domain. If X(f} = Fix(t)}, then 


FKD = JASA) (13.9) 
F [Fo] = URP) 4.3.10) 


7. Convolution: Convolution in the time domain is equivalent to multiplication in the 
frequency domain, and vice versa. If X(f) = F[x(s)] and ¥(f) = F[y(e)], then 


F x(t) x yD) = XHY (S) (1.3.11) 
FIDIO] = X(f) Yf) (1.3.12) 


8. Parseval’s relation: If X(f) = Fix(t)] and Y(f) = F [y(t], then 


f xy" (e) de =f XYP af (1.3.13) 
n P 
3 = 

[mcr a = [xine ar (13.14) 
ae be 


The second relation is also referred to as Rayleigh’s relation. 


Table 1.1 gives the most useful Fourier transform pairs. In this table u(t) denotes the 
unit step function, ô(z) is the impulse signal, sgn(t) is the signum function, defined as 


h t>0 
sgn(t) = { 0. t=0 (4.3.15) 
-1, t<0 


and 6()(t) denotes the nth derivative of the impulse signal. 
For a periodic signal x(t), with period To, whose Fourier series coefficients are given 
by Xn, i€., 


kasd 
a= YO arpei? 


n=-00 


20 
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cos(2r for) I8 = fo) + (fF + So) 
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Table 1.!: Table of Fourier transform pairs. 
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the Fourier transform is obtained by 


X(f) = Fixa 


~ 
F > ype Ta 


n=-x 


tl 


x 


3 nF fenus] 


n=-N 
x 


yD w(- =) (1.3.16) 


n=-x 


il 


In other words the Fourier transform of a periodic signal consists of impulses at multiples 
of the fundamental frequency (harmonics) of the original signal. 

It is also possible to express the Fourier series coetficients in terms of the Fourier 
transform of the rruncated signal by 


1 n 
maNga 3. 
Xp Th Ty (=) (1.3.17) 


where by definition X7,(f) is the Fourier transform of +7,(1), the truncated signal, defined 
by 


Pa i 

x(t), Ters 
xni) = S ais 1.3.18 
mitt? 5 otherwise í J 


The Fourier transform of a signal is called the spectrum of the signal. The spectrum of 
a signal in general is a complex function X (f); therefore, to plot the spectrum, usually two 
plots are provided—the magnitude spectrum |X (f)| and the phase spectrum ¿ X(f). 





ILLUSTRATIVE PROBLEM 
Illustrative Problem 1.5 [Fourier transforms] Plot the magnitude and the phase spectra 
of signals x) (¢) and x2(?) shown in Figure !.14. 
s x(t) t valt) 


1 fae 

















Figure 1.14: Signals xj(¢) and x2(t). 
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Ei 


Since the signals are similar except for a time shift. we would expect them to have the same 
magnitude spectra, The common magnitude spectrum and the two phase spectra plotted on 
the same axis are shown in Figures 1.15 and 1.16, respectively. 
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Figure 1.15: The common magnitude spectrum of the signals x;(t) and x2(t). 


The MATLAB script for this problem is given below. In Section 1.3.1 we show how to 
obtain the Fourier transform of a signai using MATLAB. 








% MATLAB script for Hlustrative Problem 5. Chapter } 
df=0.01; 





xl=zeros(size(t)); 
x1(41:51)=t(41:51)+1; 

x1(52:61)=ones(size(x 1(52:61))); 

x2=zeros(sizett)), 

*2(51:71)=x (41:61); 

[XL x11 dl J=fftseq(x 1 ts.dé); 

(X2,x21 df2]=fftseq(x2,t5.d6); 

X1l=X1/fs; 

X21=X2/fs; 

f=(0:dfl df (length(x!1)—1)]~fs/2; 

plot(,fftshift(abs(X 1 1))) 

plot(f(500:525), fitshift(angle(X 1 1(500:525))).f(500: 525).fftshift(angie(X21500:525))), -- °) 








| 
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Figure 1.16: The phase spectra of the signals xi Ct) and x2(1). 


1.3.1 Sampling Theorem 


The sampling theorem is one of the most important results in signal and system analysis; it 
forms the basis for the relation between continuous-time signals and discrete-time signals. 
The sampling theorem says that a bandlimited signal—i.e., a signal whose Fourier transform 
vanishes for |f| > W for some W—can be completely described in terms of its sample 
values taken at intervals T, as long as T, < 1/2W. If the sampling is done at intervals cee 
1/2W, known as the Nyquist interval (or Nyquist rate), the signal x(t) can be reconstructed 
from the sample values {x[n] = xT: A-o a 


æ% 


x)= SO x(T,)sine QW ~ nT,)) (1.3.19) 


n=~00 


This result is based on the fact that the sampled waveform xg(r) defined as 





æ 
v= D> aT) nT) (1.3.20) 
n27% 
has a Fourier transform given by 
1 n 
Xs(f) 7 >. x(s- z) for all f 
n==00 

4 

= 7X) for |f| < W (1.3.21) 
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so passing it through a lowpass filter with a bandwidth of W and a gain of F, in the passband 
will reproduce the original signal. 

Figure 1.17 is a representation of Equation (1.3.19) for T, = 1 and binga 
{1, 1, —1.2, —2, 1, 2}. In other words, 





x(t) = sinc(? + 3) + sinc(t + 2) — sinc(t + t) + 2sinc(t) 
— 2sinc(t — 1) + sinc(r — 2) + 2sinc(s — 2) 
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Figure 1.17: Representation of the sampling theorem. 


The discrete Fourier transform (DFT) of the discrete-time sequence x[n] is expressed 
as 


oo 
Xf) = ys x[nje Jit (1.3.22) 


n==00 
Comparing Equations (1.3.22) and (1.3.21) we conclude that 
X(f) = T Xal f) for | fi <W (1.3.23) 


which gives the relation between the Fourier transform of an analog signal and the discrete 
Fourier transform of its corresponding sampled signal. 


AROSE i n NAN CN LEBEN $ a 
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Numerical computation of the discrete Fourier transform is done via the well-known fast 
Fourier transform ( FFT) algorithm. In this algorithm a sequence of length N of samples of 
the signals x(r) taken at intervals of T, is used as the representation of the signal. The result 
is a sequence of length N of samples of Xy{f) in the frequency interval [0, fs], where 
fs = 1/T, = 2W is the Nyquist frequency. When the samples are Af = f,/N apart, the 
value of Af gives the frequency resolution of the resulting Fourier transform. In order to 
improve the frequency resolution, we have to increase N, the length of the input signal. 
The FFT algorithm is computationally efficient if the tength of the input sequence, N, is a 
power of 2. In many cases if this length is not a power of 2, it is made to be a power of 2 
by techniques such as zero-padding. Note that since the FFT algorithm essentially gives 
the DFT of the sampled signal, in order to get the Fourier transform of the analog signal we 
have to employ Equation (1.3.23). This means that after computing the FFT, we have to 
multiply it by T;, or, equivalently, divide it by fy, in order to obtain the Fourier transform 
of the original analog signal. 

The MATLAB function fftseq.m, given below, takes as its input a time sequence m, the 
sampling interval r, , and the required frequency resolution df and returns a sequence whose 
length is a power of 2, the FFT of this sequence M. and the resulting frequency resolution. 








function [M,m,df]=fftseq(m.ts.df) 


% {M.m} = fftsegtmss.df) 
% {[Mum.df} = ftsegtm.ts) 
%FFTSEQ Generates M, the FFT of the sequence m 
% The sequence ts zerv-pudded to meet the requred frequency resolution df. 
% is is the sampling interval. The output df is the final frequency resolution. 
% Output m ıs the zero-padded versum of input m. M it the FFT. 
fs=1/ts, 
if nargin == 2 
nl=0; 
else 
al=fs/df: 
end 
a2=tength(m), 
n=27(max(nextpow2(n!).nextpow2{n2)); 
M=fit(m.n): 
m=f{m,zeros(1.n—n2)]: 
df=fs/n: 





ILLUSTRATIVE PROBLEM 


Dustrative Problem 1.6 (Analytical and numerical derivation of the Fourier trans- 
form) The signal x(t} is descnbed by 


+2, —2 <r < -l 
A -i <t<l 

x(t) = t42 l<r<2 (1.3.24) 
0. otherwise 


and is shown in Figure 1.18. 
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n 


Figure 1.18: The signal x(t). 


1. Determine the Fourier transform of x (r) analytically and plot the spectrum of x(t). 


2. Using MATLAB, determine the Fourier transform numerically and plot the result. 


Ei» — 





l. The signal x(r) can be written as 


x(t) = 2A (5) = AW) (1.3.25) 


and therefore 


X(f) = 4sinc?(2) - sinc?( f) (1.3.26) 


where we have used, linearity, scaling, and the fact that the Fourier transform of A(t) 
is sinc?(f). Obviously the Fourier transform is real. The magnitude-spectrum is 
shown in Figure 1.19. 


2. In order to determine the Fourier transform using MATLAB, we first give a rough 


estimate of the bandwidth of the signal. Since the signal is relatively smooth, its 
bandwidth is proportional to the inverse time duration of the signal. The time duration 
of the signal is 4. To be on the safe side we take the bandwidth as ten times the inverse 
time duration, or 


BW = 10x (1.3.27) 





and therefore the Nyquist frequency is twice the bandwidth and is equal to 5. Hence, 
the sampling interval is T, = 1/f, = 0.2. We consider the signal on the interval 
(—4, 4] and sample it at T, intervals. With this choice, using a simple MATLAB 
script employing the fftseq.m function, we can derive the FFT numerically. We have 
chosen the required frequency resolution to be 0.01 Hz, so the resulting frequency 
resolution returned by fftseq.m is 0.0098 Hz. which meets the requirements of the 
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Frequency 


Figure 1.19: The magnitude-spectrum of x(r) derived analytically. 


problem. The signal vector x, which has length 41, is zero-padded to a length of 256 
to meet the frequency-resolution requirement and also to make it a power of 2 for 
computational efficiency. A plot of the magnitude-spectrum of the Fourier transform 
is given in Figure 1.20. 


The MATLAB script for this problem is given below. 





% MATLAB script for Hlustrative Problem 6, Chapter } 
echo on 


1520.2; % set paramerers 
fs=1/ts: 

df=0.01; 

x=(zeros(1.10).{0:0.2:1],ones(1.9),(1:-0.2:0},zeros( 1.10)}; 

IX. 
XL 





ya4a(sine(2efl)). ~2—(sine(Fl)).° 2; 


x.dfl J=fftseq(x.ts.df): % derive the FFT 


=X/fs: % scaling 


dE dfl a(length(x)—1)]=fs/2: 
-2.5:0.001:2.5}, 


% frequency vector for FFT 
% frequency vector for analytic approach 
% exact Fourier transform 


pause % Press a key tu see the plot of the Fourier Transform derived analytically 


olf 


subplot(2.1,1) 

plot(flabsty)); 

xlabel(‘ Frequency‘) 

litle(’ Magnitude-pectrum of x(t) derived analytically’) 

Pause % Press akey tu see the plot of the Fourier transform derived numerically 
subplot(2,1,2) 
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Figure 1.20: The magnitude-spectrum of x{r) derived numerically. 
plot(f,ffeshift(abs(X1))); 


slabel(‘ Frequency ‘) 
utle(’ Magnitude-pectrum of x(t) derived sumericaliy’) 





1.3.2 Frequency Domain Analysis of LTI Systems 


The output of an LTI system with impulse response Ah(r) when the input signal is x(t) is 
given by the convolution integral 


y(t) = x(t) + R(t) (1.3.28) 


Applying the convolution theorem we obtain 


YAH = XMH) (1.3.29) 
where 
æ 
H= Feo = f hei di (1.3.30) 
-œ 


is the transfer function of the system. Equation (1.3.29) can be written in the form 


YA = IXH 4331) 
LY(f) = £X(f) + LHS) 


which shows the relation between magnitude and phase spectra of the input and the output. 


ee 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 1.7 [LT] system analysis in the frequency domain] The signal x(t) 
whose plot is given in Figure 1.21 consists of some line segments and a sinusoidal segment. 








Figure 1.21: The signal x(t). 


1. Determine the FFT of this signa} and plot it. 


w 


If the signal is passed through an ideal lowpass filter with a bandwidth of 1.5 Hz, find 
the output of the filter and plot it 


3. If the signal is passed through a filter whose impulse response is given by 


t Ost<l 
Ate pl ists? (1.3.32) 
0, otherwise 


derive an expression for the filter output. 


ex mmm 


First we derive an expression for the sinusoidal part of the signal. This is a sinusoidal 
whose half-period is 2: therefore. it has a frequency of fo = l = 0.25 Hz. The signal has 
an amplitude of 2 and is raised by 2, so. the general expression for itis 2cos(2m x 0.25t + 


8) +2 = 2cos(0.Sxt + 6) + 2. The value of the phase @ is derived by employing the 
boundary conditions 





2+ 2cos(O0.577 +8) = 0 (1.3.33) 
or @ = 0. Therefore. the signal can be written as 
t+2, -2 <t <0 
1, Q<t<t 
x(t) = 924 2cos(0.5mt), 1<1<3 (1.3.34) 
ts 3<1<4 
0, otherwise 


Having a complete description of the signal we can proceed with the solution. 
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1. The bandwidth of the signal has been chosen to be 5 Hz. The required frequency 
resolution is 0.01 Hz. The plot of the magnitude-spectrum of the signal is given in 
Figure 1.22. 














Figure 1.22: Magnitude-spectrum of the signal. 


2. Here fs = 5Hz. Since the bandwidth of the lowpass filter is 1.5 Hz, its transfer 
function is given by 
1, O<f<1s 
H(f) = 40. ise <35 (1.3.35) 
1, 35<f <5 


which is multiplied by X(f} to generate ¥(f), the Fourier transform of the output. 
Using this transfer function gives the output shown in Figure 1.23. 


3. Here we obtain the output of the filter by a simple convolution. The result is shown 
in Figure 1.24. 


The MATLAB script for this problem is given below. 





% MATLAB script for Hlustrative Problem 7, Chapter I 


echo on 

df=0.01; % freq. resolution 
fs=5; % sampling frequency 
ts=1/f % sampling interval 








xezeros(1length(t)); 


*(16:26)=t(16:26)+2; 


% time vector 
% input signal initiation 
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Figure 1.23: The output of the lowpass filter. 














Figure 1.24: The output signal in the third part of the problem, 
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x(27:31)=2eones(1.5); 
(32:41 }=2+2ecos(0.Sepi4(32:41)): 
x(42:46)=2eones(1,5); 


% part 1 

(X.x1 dfl J=fftseq(.ts.df); % spectrum of the input 
f=[0:df 1: df «(length(x1)—1)J—f5/2: % frequency vector 
X1=X/fs; % scaling 

% purt 2 


F filter transfer function 

Hefones(1 ceil 1,5/dfl)),zerost 1 length X )—2«ceil( 1.5/di1)).onest 1.cerl(1.5/dt)))] 
=H; % ouput spectrum 

yl=ifft Y); % output of the filter 

% part 3 

% LTI system impulse response 

h=[zeros(1 ,ceil(5/ts)),t(ceil(S/ts)+ 1 ceil /ts)),ones( 1 ceil(7 /ts)~ceil(6 /ts)).zerast 1,51 —ceil(7 /ts))}; 
y2=conv(h.x); % output of the LTH system 
pause % Press a key to see spectrum of the input 

plot f.fftshift(abs(X1))) 

pause % Press u key to see the output of the lowpass Alter 

plot(t,abs(y it {-length(r)))), 

pause % Press a key to see the output of the LTI system 
plot((—10:t8:10},y2). 









1.4 Power and Energy 


The energy and the power contents of a real signal x (1), denoted by Ey and Px, respectively, 
are defined as 


ad 2 
Ex =f x(tydt 
ae Lyte (1.4.1) 
2 
Pr = tim = fs (de 


A signal with finite energy is called an energy-type signal, and a signal with positive and 
finite power is a power-type signal.* For instance x(t) = TI{¢) is an example of an energy- 
type signal, whereas x(t) = cos(t) is an example of a power-type signal. All periodic 
signals® are power-type signals. The energy spectral density of an energy-type signal gives 
the distribution of energy at various frequencies of the signal and is given by 


Bx) = XÈ (1.4.2) 


Therefore, 


td 
Ei -f Sx fdf (143) 
~20 





‘There exist signals that are neither energy type nor power type. One example of such signals is x(1) = 
1 
eua 
SThe only exception is those signals that are equal to zero almost everywhere. 
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Using the convolution theorem we have 


Exi) = F[Ryx(t)] (1.4.4) 


where Ry(t) is the autocorrelation function of xit) defined as j 
p 
Rxit) =j xUju(t + r)dt 
—x 


= x(t) ex(—7) 1.4.3) 


for real-valued signats. For power-type signals we define the time-average autocorrelation 
function as 


E FRE 
Ry(t) = lim =J viru(t + r)dt (1.4.6) 


Tax 





and the power spectral density is in general given by 
Sxl Ff) = FIRI] (1.4.7) 


The totai power is the integral of the power spectral density given by 





x 
Py f Sx( pdf (1.4.8) 


z 
For the special case of a periodic signal x (z) with period To and Fourier series coefficients 
Xn. the power spectral density is given by 


z 
sD Do wsh- 2) 149) 


which means all the power is concentrated at the harmonics of the fundamental frequency, 
and the power at the nth harmonic {7 / To) is Ixyl? . ie.. the magnitude square of the corre- 
sponding Fourier series coefficient. 


When the signal x(:) passes through a filter with transfer function H(f), the output 
energy spectral density, or power spectral density, is obtained via 


By(f) = IAAP Ex(f) 
fe (1.4.10) 
Sy(f) = HCP PSK) 


If we use the discrete-time (sampled) signa], the energy and power relations equivalent to 
Equation (1.4.1) in terms of the discrete-time signal become 








: 
Ex D Pe 
sete 
(1.4.11) 
: fe Ses 
Pam Ji art le 
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and if the FFT is employed-—i.c.. if the length of the sequence is finite and the sequence is 
repeated—then 


N-I 
Ex=7,}_ vh] 

asd 

N=! 


P= 5 ein 


n=0 


(1.4.12) 


The following MATLAB function power.m gives the power content of a signat vector. 





function p=power(x) 
% p = powertx) 
TPOWER Returns the power in signal « 
p={norm(x)*2)/length(x); 





If Xu(f) is the DFT of the sequence x{n}, then the energy spectral density of x(r), the 
equivalent analog signal, is obtained by using the Equation (1.3.23) and is given by 


aA = TRIX? (1.4.13) 


where T, is the sampling interval. The power spectral density of a sequence x(n} is most 
easily derived by using the MATLAB function spectrum.m. 
ILLUSTRATIVE PROBLEM 





Nilustrative Problem 1.8 {Power and power spectrum] The signal x(r) has a duration of 
10 and is the sum of two sinusoidal signals of unit amplitude. one with frequency 47 Hz 
and the other with frequency 219 Hz. 


w= cos(2m x 471) + cos(2z x 2191), O<1< 10 
ee 0, otherwise 


This signal is sampled at a sampling rate of 1000 samples per second. Using MATLAB, 
find the power content and the power spectral density for this signal. 


e 


Using the MATLAB function power.m the power content of the signal is found to be 
1.0003 W. By using spectrum.m and specplot.m, we can plot the power spectral density of 
the signal, as shown in Figure 1.25, The twin peaks in the power spectrum correspond to 
the two frequencies present in the signal. 

The MATLAB script for this problem follows. 








| 
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Figure 1.25: The power spectral density of the signal consisting of two sinusoidal signals 
at frequencies f; = 47 and fz = 219 Hz. 


mna 


% MATLAB script for Illustrartive Pmblem 8, Chapter | 
ts=0.001; 

fs=1/ts; 

t={0:ts:10]; 

x=cos(2epi+47e1)+cos(2apis219at); 

p=power(x); 

psd=spectrum(x.1024); 

pause % Press a key to see the power in the signal 





P 
pause % Press a key to see the power spectrum 
specplot(psd.fs) 





1.5 Lowpass Equivalent of Bandpass Signals 


A bandpass signal is a signal for which all frequency components are located in the neigh- 
borhood of a central frequency fo (and, of course, — fo). In other words, for a bandpass 
signal X(f) = 0 for |f + fol > W, where W < fo. A lowpass signal is a signal for 
which the frequency components are located around the zero frequency; i.e., for | f| > W, 
we have X(f) = 0. 


Corresponding to a bandpass signal x(t) we can define the analytic signal z(t), whose 
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Fourier transform is given as 
Z(f) = u- PXS) (1.5.1) 
where u_;(f)is the unit step function. In the time domain this relation is written as 
a(t) = x(t) + JÈN) (1.5.2) 


where £(t) denotes the Hilbert transform of x(t) detined as (1) = x(t)» 4 jin the frequency 
domain it is given by 


X(f) = jse Xf) (15.3) 


We note that the Hilbert transform function in MATLAB, denoted by hilbert.m, generates 
the complex sequence z(r). The real part of z(r) is the original sequence, and its imaginary 
part is the Hilbert transform of the original sequence. 

The lowpass equivalent of the signal x(t), denoted by x;(r), is expressed in terms of 
z(t) as 


ay(t) = c(ne7 728 F0t (1.5.4) 
From this relation we have 


x(t) = Re(x(t)e?" A] 


H(t) = Imfar(r)et 7] eed 
In the frequency domain we have 
Xi(f) = ZF + fo) = Qui f + OX + fod (1.5.6) 
and 
Xf) =X - fo) + XOS = fo) (1.5.7) 


The lowpass equivalent of a real bandpass signal is, in general, a complex signal. Its real 
part, denoted by x(t), is called the in-phase component of x(t) and its imaginary part is 
called the quadrature component of x(t) and is denoted by x,(f}; i.e., 


Att) = XC) + XO) (1.5.8) 
In terms of the in-phase and the quadrature components we have 


x(t) = xe(t) cos(2 fot) — x(t) sin(2z for) 


A (1.5.9) 
R(t) = xs (t) cos(2m fot) + xc (t) sin(2x fot) 
If we express x;(¢) in polar coordinates, we have 
a(t) = Viel (1.5.10) 


H 
| 
| 





“im 
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where V(r) and ©(¢) are called the envelope and the phase of the signal x(t). In terms of 
these two we have 


x(t) = V(t) cos(27 for + O(¢)) (1.5.11) 


The envelope and the phase can be expressed as 


V(r) = fx) + x2(1) 


(1.5.12) 
©(r) = arctan 20. 
Xel) 
or, equivalently, 

V(t) = yx?) + F241) 

i 1.5.13) 
(1) = arctan a 2x fot ( 

x(t) 


It is obvious from the above relations that the envelope is independent of the choice of fo, 
whereas the phase depends on this choice. 

We have written some simple MATLAB files to generate the analytic signal, the lowpass 
representation of a signal, the in-phase and quadrature components, and the envelope and 
phase. These MATLAB functions are analytic.m, loweq.m, quadcomp.m, and env_phas.m, 
respectively. A listing of these functions is given below. 


<= $__-__--____ 


function z=analytic(x) 





& z = unalyticts} 

GANALYTIC Returns the analytic signal corresponding to signal x. 
% 

z=hilbert(x): 





<=> ——— 


function xl=loweq(x.ts,f0) 





% al = loweq(x.ts,f0) 

%LOWEQ Returns the lowpass equivalent of the signal z 
% fo is the center frequency. 

% fx is the sampling interval. 

% 


t=(0:ts:ts*(length(x)—1)]: 
shilbert(x); 
xl=z.sexp(—j+2epiatOet); 


-a 


function [xc,xs}=quadcomp(x,ts,f0) 
% {xc.xs} = quadcompts,ts,f0) 
%QUADCOMP Returns the in-phase and quadrature components of 


















38 CHAPTER I. SIGNALS AND LINEAR SYSTEMS 


% the signal x. fO is the center frequency. ts is the 
% sampling interval, 

% 

z=loweg(x,ts, (0); 

xc=real(z); 

xs=imag(z); 


al — 


function [v,phi]=env_phas(x,ts,f0) 
% [vphi] = env phastsx.ts,f0) 











% v = env phas(x,ts JO) 
%ENV_PHAS Returns the envelope und the phase of the bandpass signal x 
% JO is the center frequency. 
h ts is the sampling interval. 
% 
if nargout == 
z=loweg(x,ts,f0); 
phi=angle(z); 
end 


vaabs(hilbert(x)); 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 1.9 {Bandpass to lowpass transformation] The signal x(t) is given 
as 








x(t) = sine(100r) cos(27 x 2001) (1.5.14) 
1. Plot this signal and its magnitude spectrum. 


2. With fo = 200 Hz, find the lowpass equivalent and plot its magnitude spectrum. Plot 
the in-phase and the quadrature components and the envelope of this signal. 


3. Repeat part 2 assuming fo = 100 Hz. 


<D 


Choosing the sampling interval to be t, = 0.00! s. we have a sampling frequency of 
fs = 1/t, = 1000 Hz. Choosing a desired frequency resolution of df = 0.5 Hz, we have 
the following. 


1. Plots of the signal and its magnitude spectrum are given in Figure 1.26. Plots are 
generated by MATLAB, 


2. Choosing fo = 200 Hz, we find the lowpass equivalent to x(t) by using the loweq.m 
function. Then using fftseq.m we obtain its spectrum; we plot its magnitude-spectrum 
in Figure 1.27. 
It is seen that the magnitude spectrum is an even function in this case, because we 
can write 


x(t) = Re[sinc(100r)¢/2" x200] (1.5.15) 


hE A Aabi AE a oun a aan 
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Figure 1.26: The signal x(t) and its magnitude-spectrum. 


oma 




















— . — 
oat cf 4 
aso 

exo 

oe L 

oome 

° n 

a a — a a a eee 9 

tregoemsy 


Figure 1.27: The magnitude-spectrum of the lowpass equivalent to x(¢) in Illustrative 
Problem 1.9 when fo = 200 Hz. 
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Comparing this to 
x(t) = Refr (ne! A] (1.5.16) 
we conclude that 
x(t) = sine(100r) (4.5.17) 


which means that the lowpass equivalent signal is a real signal in this case. This, in 
turn, means that xe(t) = x;(¢) and x(t} = 0. Also, we conclude that 


V(t) = lee! 
0, x(t) 20 (1.5.18) 


er) = 
9 n, x(t) <0 


Plots of x(t) and V(¢) are given in Figure 1.28. 











Figure 1.28: The in-phase component and the envelope of x(r). 


Note that choosing this particular value of fo, which is the frequency with respect to 
which X(f) is symmetric, yields in these results. 


. If fo = 100 Hz, then the above results will not be true in general, and x;(t) will be a 


complex signal. The magnitude spectrum of the lowpass equivalent signal is plotted 
in Figure 1.29, As its is seen here, the magnitude spectrum lacks the symmetry 
present in the Fourier transform of real signals. Plots of the in-phase components of 
x(t) and its envelope are given in Figure 1.30. 
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Figure 1.29: 


The magnitude spectrum of the lowpass equivalent to x(f) in Illustrative 


Problem 1.9 when fo = 100 Hz. 




















=} 1, 
Figure 1.30: The in-phase component and the envelope of the signal x(t) when fo = 100 


Hz. 
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Problems 


1.1 Consider the periodic signal of Iflustrative Problem 1.1 shown in Figure 1.1. Assuming 
A = l, To = 10, and f = L, determine and plot the discrete spectrum of the signal. Com- 
pare your results with those obtained in Illustrative Problem 1.1 and justify the differences. 


1.2 In Illustrative Problem 1.1, assuming A = 1, Tọ = 4, and tọ = 2, determine and plot 
the discrete spectrum of the signal. Compare your results with those obtained in Illustrative 
Problem 1.1 and justify the differences. 


13 Using the m-file fseries.m, determine the Fourier series coefficients of the signal shown 
in Figure 1.1 with A = 1, Tọ = 4, and tọ = 3 for —24 < n < 24. Plot the magnitude 
spectrum of the signal. Now using Equation (1.2.5) determine the Fourier series coefficients 
and plot the magnitude spectrum. Why are the results not exactly the same? 


1.4 Repeat Problem 1.3 with To = 4.6, and compare the results with those obtained by 
using Equation (1.2.5). Do you observe the same discrepancy between the two results here? 
Why? 


1.5 Using the MATLAB script dis_spet.m, determine and plot the phase spectrum of the 
periodic signal x(r) with a period of Tọ = 4.6 and described in the interval [—2.3, 2.3] by 
the relation x(t) = A(t). Plot the phase spectrum for —24 < n < 24. Now, analytically 
determine the Fourier series coefficients of the signal, and show that all coefficients are 
nonnegative real numbers. Does the phase spectrum you plotted earlier agree with this 
result? If not, explain why. 


1.6 In Problem 1.5, define x(t) = A(t) in the interval [-1.3, 3.3}; the period is still 
To = 4.6. Determine and plot the magnitude and phase spectra using the MATLAB script 
dis_spct.m. Note that the signal is the same as the signal in Problem 1.5. Compare the 
magnitude and the phase spectra with that obtained in Problem t.5. Which one shows a 
more noticeable difference, the magnitude or the phase spectrum? Why? 


1.7 Repeat Illustrative Problem 1.2 with {a, b] = [—4, 4] and x(t) = cos(1/8) for l| <4. 


1.8 Repeat Illustrative Problem 1.2 with (a, b] = [—4, 4] and x(t) = sin(rr/8) for [t| < 4 
and compare your results with those of Problem 1.7. 


1.9 Numerically determine and piot the magnitude and the phase spectra of a signal x(t) 
with a period equal to 1076 seconds and defined as 


~10% +05, O<1<5x 10-7 
otherwise 


x= 


in the interval |t| < 5 x 1077. 





Don ai [ingia apan 


veva 


Me we 


waans, 


1.5. Lowpass Equivalent of Bandpass Signals 43 


1.10 A periodic signal x(t) with period To = 6 is defined by x(t) = M (1/3) for It] <3. 
This signal passes through an LTI system with an impulse response given by 


“2 ger<4 
Aaya fe OFFS 
0. otherwise 


Numerically determine and plot the discrete spectrum of the output signal. 
1.11 Repeat Problem 1.10 with x(t) = e7% for |t| < 3 and 


I, 0<rs<4 
0, otherwise 


hi) = | 


1.12 Verify the convolution theorem of the Fourier transform for signals x(t) = T(r) and 
y(t) = A(t) numerically, once by determining the convolution directly and once by using 
the Fourier transforms of the two signals. 


1.13 Piot the magnitude and the phase spectra of a signal given by 


l, -2<t<-t 
Ith lel 

L olst<2 

0, otherwise 


1.14 Determine and plot the magnitude spectrum of an even signal x (r) which for positive 
values of 1 is given as 


t+1, O<rt<1 


2, LSI 
x(t) = 

=t +4, 2s1<4 

0, otherwise 


Determine your result both analytically and numerically and compare the results. 


1.15 The signal described in Problem 1.14 is passed through an LTI system with an impulse 
response given by 


1, O<1<2 
AQ) = 42, 2<1<3 
0, otherwise 


Determine the magnitude and the phase spectra of the output signal, 
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1.16 The signal 


cos(2m x 471) + cos(2x x 2197), Ost < 10 


YS 0, otherwise 


is considered. As in Illustrative Problem 1.8, assume this signal is sampled at a rate of 1000 
samples/second. Using the MATLAB M-file butter.m, design a lowpass Butterworth filter 
of order 4 with a cutoff frequency of 100 Hz and pass x(t) through this filter. Determine 
and sketch the output power spectrum and compare it with Figure 1.25. Now design a 
Butterworth filter of order 8 with the same cutoff frequency, and determine the output of 
this filter and plot its power spectrum. Compare your results in theses two cases. 


1,17 Repeat Problem 1.16, but this time design highpass Butterworth filters with the same 
orders and the same cutoff frequencies. Plot your results and make the comparisons. 


1.18 Consider the signal 


cos(2m x 47r) + cos(2m x 2197), OS: < 10 


sms 0, otherwise 


a. Determine the analytic signa! corresponding to this signaì. 
b. Determine and plot the Hitbert transform of this signal. 
c. Determine and piot the envelope of this signal. 


d. Once assuming fo = 47 and once assuming fọ = 219, determine the lowpass 
equivalent and the in-phase and the quadrature components of this signal. 
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Chapter 2 


Random Processes 


2.1 Preview 


In this chapter we illustrate methods for generating random variabtes and samples of random 
processes. We begin with the description of a method for generating random variables witha 
specified probability distribution function. Then, we consider Gaussian and Gauss-Markov 
processes and illustrate a method for generating samples of such processes. The third topic 
that we consider is the characterization of a stationary random process by its autocorrelation 
in the time domain and by its power spectrum in the frequency domain. Since linear filters 
play a very important role in communication systems, we also consider the autocorrelation 
function and the power spectrum of a linearly filtered random process. The final section of 
this chapter deals with the characteristics of lowpass and bandpass random processes. 


2.2 Generation of Random Variables 


Random number generators are often used in practice to simulate the effect of noiselike 
signals and other random phenomena that are encountered in the physical world. Such noise 
is present in electronic devices and systems and usually limits our ability to communicate 
over large distances and to detect relatively weak signals. By generating such noise on a 
computer, we are able to study its effects through simulation of communication systems 
and to assess the performance of such systems in the presence of noise. 

Most computer software libraries include a uniform random number generator. Such 
a random number generator generates a number between 0 and 1 with equal probability, 
We call the output of the random number generator a random variable. If A denotes such a 
random variable, its range is the interval O < A < 1. 

We know that the numerical output of a digital computer has limited precision, and 
as a consequence it is impossible to represent the continuum of numbers in the interval 
0 < A < 1. However, we may assume that our computer represents each output by a 
large number of bits in either fixed point or floating point. Consequently, for all practical 
purposes, the number of outputs in the interval 0 < A < 1 is sufficiently large, so that we 
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are justified in assuming that any value in the interval is a possible output from the generator. 

The uniform probability density function for the random variable A, denoted as f(A), 
is illustrated in Figure 2.!(a). We note that the average value or mean value of A, denoted 
asma, ism, = $. The integral of the probability density function, which represents the 
area under f(A), is called the probabiliry distribution function of the random variable A 
and is defined as 


A 
F(a = f fla)ds 21) 
a 


For any random variable, this area must always be unity, which is the maximum value that 
can be achieved by a distribution function. Hence, for the uniform random variable A we 
have 


l 
FD -f f(x)dx =1 (2.2.2) 


and the range of F(A) is 0 < F(A) < lt forO < A < 1. The probability distribution 
function is shown in Figure 2.1(b). 


F(A) 





(b) 


Figure 2.1: Probability density function f(A) and the probability distribution function 
F(A) of a uniformly distributed random variable A. 


If we wish to generate uniformly distributed noise in an interval (b, b + 1), it can be 
accomplished simply by using the output A of the random number generator and shifting 
it by an amount b. Thus a new random variable 8 can be defined as 


B=A+b (2.2.3) 


which now has a mean value mg = b + }. For example, if b = ~}, the random variable B 
is uniformly distributed in the interval (~}, $), as shown in Figure 2.2(a). Its probability 
distribution function F(B) is shown in Figure 2.2(b). 


[4 yaranma} aa, 
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A uniformly distributed random variable in the range (0,1) can be used to generate 
random variables with other probability distribution functions. For example, suppose that 
we wish to generate a random variable C with probability distribution function F(C), as 
illustrated in Figure 2.3. 3 





{b) 


Figure 2.2: Probability density function and the probability distribution function of a zero- 
mean uniformly distributed random variable. 





Figure 2.3: Inverse mapping from the uniformly distributed random variable A to the new 
random variable C. 


Since the range of F(C) is the interval (0,1), we begin by generating a uniformly 
distributed random variable A in the range (0,1). If we set 


F(C)=A (2.2.4) 
then 


C = F'(A) (2.2.5) 
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Thus we solve (2.2.4) for C, and the solution in (2.2.5) provides the value of C for which 

F(C) = A. By this means we obtain a new random variable C with probability distribution 

F(C). This inverse mapping from A to C is illustrated in Figure 2.3. 
ILLUSTRATIVE PROBLEM 


Blustrative Problem 2.1 Generate a random variable C that has the linear probability 
density function shown in Figure 2.4(a); i.e., 


4C, 0<C <2 


JOYS 0, otherwise 


KO) 


win 





-c 





(a) 


Figure 2.4: Linear probability density function and the corresponding probability distribu- 
tion function. 


—Gi- 


This random variable has a probability distribution function 





0 C<d 
F(C)=44C?, 0<C <2 
i C>2 


which is illustrated in Figure 2.4(b). We generate a uniformly distributed random variable 
A and set F(C) = A. Hence 


i 


F(C) = ro =A (2.2.6) 


Upon solving for C, we obtain 


C=2WA (2.2.7) 


een te Ee tore ne TY 
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Thus we generate a random variable C with probability function F(C), as shown in Figure 
2.4(b). 

In Hlustrative Problem 2.1 the inverse mapping C = F7!(A) was simple. In some 
cases it is not. This problem arises in trying to generate random numbers that have a normal 
distribution function. 

Noise encountered in physical systems is often characterized by the normal, or Gaussian, 
probability distribution, which is illustrated in Figure 2.5. The probability density function 
is given by 


-0 < C < œ (2.2.8) 





where o? is the variance of C. which is a measure of the spread of the probability density 
function f(C). The probability distribution function F(C) is the area under f(C) over the 
range (—o¢, C). Thus 


€ 
F(C) =f fix)dx (2.2.9) 
-o0 


f(C) F(C) 





ol 0 
(a) b) 


Figure 2.5: Gaussian probability density function and the corresponding probability distri- 
bution function. 


Unfortunately, the integral in (2.2.9) cannot be expressed in terms of simple functions. 
Consequently, the inverse mapping is difficult to achieve. A way has been found to circum- 
vent this problem. From probability theory it is known that a Rayleigh distributed random 
variable R, with probability distribution function 


R<0 


0. 
FRA VR? Rao 


(2.2.10) 
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is related to a pair of Gaussian random variables C and D through the transformation 


C = ReosO (2.2.11) 
D = Rsinð (2.2.12) 


where © is a uniformly distributed variable in the interval (0, 2x). The parameter ø? is the 
variance of C and D. Since (2.2.10) is easily inverted, we have 


F(R) = 1- e A (2.2.13) 
and hence 


R = 207 In{1/(1 — A)] (2.2.14) 


where A isa uniformly distributed random variable in the interval (0,1). Now, if we generate 
a second uniformly distributed random variable B and define 


O=27B (2.2.15) 


then from (2.2.11) and (2.2.12), we obtain two statistically independent Gaussian distributed 
random variables C and D. 

The method described above is often used in practice to generate Gaussian distributed 
random variables. As shown in Figure 2.5, these random variables have a mean value of 
zero and a variance g?. If a nonzero mean Gaussian random variable is desired, then C and 
D can be translated by the addition of the mean value. 

The MATLAB script that implements the method above for generating Gaussian dis- 
tributed random variables is given below. 





function [gsrv!,gsrv2}=gngauss(m,sgma) 





% — [gsrvi.gsrv2] = gngauss(m.sgma) 
% — fgsrvl.gsrv2] = gngauss(sgma) 
% — [gsrvigsrv2} = gngauss 
% GNGAUSS generutes two independent Gaussian random variables with mean 
% m und standard deviation sgma. If one of the input arguments is missing 
% it takes the mean us O. 
% If neither mean nor the variance is given. it generates two standard 
% Gaussian random variables. 
if nargin == 
m=0; sgm: 
elseif nargin == 1, 
sgma=m, m=0; 
end; 
usrand; % a uniform random variable in (0.1) 
zesgman(sqrt(2+log(1/(1—u)))); % a Rayleigh distributed random variable 
usrand: % another uniform random variable in (0,1) 


gsrvl=m+zecos(2apiau), 
gsrv2=m+zesin(2+pisu); 
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2.3 Gaussian and Gauss-Markov Processes 


Gaussian processes play an important role in communication systems. The fundamental 
reason for their importance is that thermal noise in electronic devices, which is produced 
by random movement of electrons due to thermal agitation, can be closely modeled bya 
Gaussian process, The reason for the Gaussian behavior of thermal noise is that the current 
introduced by movement of electrons in an electric circuit can be regarded as the sum of 
smal! currents of a very large number of sources, namely, individual electrons. It can be 
assumed that at least a majority of these sources behave independently and, therefore, the 
total current is the sum of a large number of independent and identically distributed (i.i.d.) 
random variables. By applying the central limit theorem, this total current has a Gaussian 
distribution, 

Apart from thermal noise, Gaussian processes provide rather good models for some 
information sources as well. Some interesting properties of the Gaussian processes, which 
are given below, make these processes mathematically tractable and easy to deal with. We 
begin with a formal definition of a Gaussian process. 





Definition: A random process X(t) is a Gaussian process if for all n and all (t), 2, ... p fn), 
the random variables (XD have a jointly Gaussian density function, which may be 
expressed as 


fœ = expl- (2 ~ mC- ~ m) (2.3.1) 


1 
(27 */2[der(C)]}/2 
where the vector x = (x1, X2, ... , Xn} denotes the n random variables xi = X(t), mis 
the mean value vector. i.e., mt = E(X). and C is the n x n covariance matrix of the random 
variables (x), x2. -.. , Xn) with elements 








ci = El(xi — mi(xj — m;)) (2.3.2) 


The superscript r denotes the transpose of a vector or a matrix and C7! is the inverse of the 
covariance matrix C. 


From the above definition it is seen, in particular, that at any time instant tọ the random 
variable X (to) is Gaussian, and at any two points f, f the random variables (X(t), X(t2)) 
are distributed according to a two-dimensional Gaussian random variable. Moreover, since 
a complete statistical description of (X(t) depends only on the mean vector m and the 


covariance matrix C, we have the following property. 


Property 1: For Gaussian processes, knowledge of the mean m and covariance C provides 
a complete statistical description of the process. 


Another very important property of a Gaussian process is concerned with its character- 
istics when passed through a linear time-invariant system. This property may be stated as 
follows. 
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Property 2: If the Gaussian process X(t) is passed through a linear, time-invariant (LTT) 
system, the output of the system is also a Gaussian process. The effect of the system on 
X(t) is simply reflected by a change in the mean value and the covariance of X (r) 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 2.2 [Generation of samples of a multivariate Gaussian process] 
Generate samples of a multivariate Gaussian random process X(r) having a specified mean 
value m, and a covariance Cy 


-mD 

First, we generate a sequence of » statistically independent, zero-mean and unit variance 
Gaussian random variables by using the method described in Section 2.2. Let us denote 
this sequence of n samples by the vector Y = (y1, y2.... . Yn). Secondly, we factor the 
desired n x n covariance matrix Cy as 





1/2 


C = CUC) (2.3.3) 
Then, we define the linearly transformed (n x 1} vector X as 
X=C Y+m (2.3.4) 
Thus the covariance of X is 
Cy = EX — mK ~ m,)') 
= EIC YY ey) 
= CP EY CY 
=c ciy (2.3.5) 


The most difficult step in this process is the factorization of the covariance matrix Cx. Let 
us demonstrate this procedure by means of an example that employs the bivariate Gaussian 
distribution. Suppose we begin with a pair of statistically independent Gaussian random 
variables yı ard yz, which have zero mean and unit variance. We wish to transform these 
into a pair of Gaussian random variables x; and x2 with mean m = 0 and covariance matrix 


2 
_| p00 
C= [oan o2 
L 
2 [i | (2.3.6) 
2 
where of and o? are the variances of x, and x2, respectively, and p is the normalized 


covariance, defined as 


ERX -mX m) c2 oan 
002 oo 





p= 


emna e mm poeme ate ener nema tenement tne 
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The covariance matrix C can be factored as 


C= cy 








where 
V3+1 V3-1 23 
aba 4a (2.3.8) 

Therefore, 

=|"! 

BEES 

=¢'? yi 

E y 

_ 1 [3+1 vrei yi 

“3a lV3-1 B+ 

= Aes oe | (2.3.9) 

5 IA LW3 - Dy + 34D» E 


The MATLAB scripts for this computation are given below. 








% MATLAB script for Hlusirative Problem 2, Chapter 2. 
echo on 

mx=[0 0)"; 

Caaf 1/2:1/2 1); 

xemulti_gp(mx.Cx), 

% Compusation of the pdf of tal. <2) follows 
delta=0.3; 





ngth(x2), 
(4 /((2xpidedet(Cxy* 1/2))eexp((—1/2)e(([x 1) xG- mx) tiny (Cx) © (xl ti}; x2()]—mx))); 


end: 
% plotting command for pdf follows 
mesh(x1,x2,f); 





-en _$______— 


function [x] = muld_gp(m,C) 

% [x] = multigpim,C) 

% MULTI-GP generates a multivariate Gaussian random 

% process with mean vector m (column vector), und covariance matrix C. 
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N=length(m); 

for i=1:N, 
yliJ=gngauss; 

end; 

ysy'; 

xesqrtm(C)*y+m; 








Figure 2.6 illustrates the joint pdf f (x, x2) for the covariance matrix C given by (2.3.6). 





1 














Figure 2.6: Joint probability density function of x, and x2. 


As indicated above, the most difficult step in the computation is determining 1/2, 
Given the desired covariance matrix, we may determine the eigenvalues {Ag, | < k < n} 
and the corresponding eigenvectors {vz, | < k < n}. Then, the covariance matrix C can 
be expressed as 


n 
C= nv (2.3.10) 
k=l 


and since C = C'/2(¢1/2)!, it follows that 


n 
CEON n (23.11) 
k=l 
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Definition: A Markov process X(t) is a random process whose past has no influence on 
the future if its present is specified. That is, if t > in—1, then 
P[X Cn) San XG) tS ty) = P[X tn) < xn | X(tn-v)] (2.3.12) 


From this definition, it follows that if ty < n <--> < tq, then 


P [X (in) Stn |X (tai), XD). XOD] = P [X Cin) S xa IX (a) (2.3.13) 


Definition: A Gauss-Markov process X(t) is a Markov process whose probability density 
function is Gaussian. 


The simplest method for generating a Markov process is by means of the simple recursive 
formula 


Xn =PXn-i +w, (2.3.14) 
when wp is a sequence of zero-mean i.i.d. (white) random variables and P is a parameter 
that determines the degree of correlation between X,, and Xn~1. That is, 


E(XnXn-1) = pE(X}_) = po} (2.3.15) 


If the sequence {wn} is Gaussian, then the resulting process X (t) is a Gauss-Markov process. 
ILLUSTRATIVE PROBLEM 





Illustrative Problem 2.3 Generate a sequence of 1000 {equally spaced) samples of a 
Gauss-Markov process from the recursive relation 


Xn =0.95Xq-1 + Wn. n=1,2,...,1000 (2.3.16) 


where Xo = O and {wn} is a sequence of zero mean and unit variance i.i.d. Gaussian random 
variables. Plot the sequence {X,, 1 <n < 1000} as a function of the time index n and 
the autocorrelation 


N-m 


1 
Rim) = Fg D XnXnim  m=0,1,...,50 (2.3.17) 
n=l 


where N = 1000. 


= — 


The MATLAB scripts for this computation are given below. Figures 2.7 and 2.8 illustrate 
the sequence (X,,) and the autocorrelation function Å, (m). 
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ee M'E ii 








% MATLAB script for illustrative Problem 3, Chapter 2 
echo on 





% plotting commands follow 


-en 


function {X}=gaus mar(XO,rho.N) 
% IX}=gausmariXO,rho.N) 








% GAUS_MAR generutes u Gauss-Markov process of length N. 
% the noise process is taken to be white Gaussian 
% noise with zero mean and unit variance 
for i=1:2.N, 
(Wsi) Wsti+1)}sgngauss; % venerate the noise process 
end; 
XO J=rhos XO+WS( 1); % first element in the Guuss-Markov process 
for i=2:N, 
X(i)=thoxX (i 1)+Ws(i); % the remaining elements 
end: 

















Figure 2.7: The Gauss-Markov sequence. 
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Figure 2.8: The autocorretation function of the Gauss-Markov process. 


2.4 Power Spectrum of Random Processes and 
White Processes 


A stationary random process X (r) is characterized in the frequency domain by its power 
spectrum §,(f), which is the Fourier transform of the autocorrelation function R,(t) of 
the random process. That is, 


æ 
SLf = f Ry (t)e PF" de (24.1) 


co 


Conversely, the autocorrelation function R,{t) of a stationary random process X (t) is 
obtained from the power spectrum §,{ f) by means of the inverse Fourier transform; i.e., 


oo 
R,(t) = f Sapi df (2.4.2) 
-0% 


In modeling thermal noise that is generated in electronic devices used in the imple- 
mentation of communication systems, we often assume that such noise is a white random 
process. Such a process is defined as follows. 

Definition: A random process X (r) is called a white process if it has a flat power spectrum, 
i.e., if §,(f) is a constant for all f. 

As indicated above, the importance of white processes stems from the fact that thermal 

noise can be closely modeled as spectrally constant over a wide range of frequencies. Also, 





we 
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a number of processes that are used to describe a variety of information sources are modeled 
as the output of LTI systems driven by a white process. 
We observe, however, that if $,() = C forall f, then 


a sDaf = f” cds = (243) 


so that the total power is infinite. Obviously, no real physical Process can have infinite 
power and, therefore, a white process may not be a meaningful physical process. However, 
quantum mechanical analysis of the thermal noise shows that it has a power-spectra! density 
given by 


Af 


—_—_ 244, 
HAT) pR 


Sif) = 


in which A denotes Planck's constant (equal to 6.6 x 107*4 Jx s) and k is Boltzmann's 
constant (equal to 1.38 x 107} J/K). T denotes the temperature in kelvins. This power 
spectrum is shown in Figure 2.9. 


cio 
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Figure 2.9: Plot of Sa (f) in (2.4.4). 


The above spectrum achieves its maximum at f = 0, and the value of this maximum 
is T, The spectrum goes to 0 as f goes to infinity, but the rate of convergence to 0 is very 
low. For instance, at room temperature {T = 300K), Sa (f) drops to 90% of its maximum 
at about f * 2 x 10!? Hz, which is beyond the frequencies employed in conventional 
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communication systems. From this we conclude that thermal noise, although not precisely 
white, can be modeled for all practical purposes as a white process with the power spectrum 
equaling a The value kT is usually denoted by No; therefore, the power-spectral density 
of thermal noise is usually given as Sn(f) = %® and is sometimes referred to as the two- 
sided power-speciral density, emphasizing that this spectrum extends to both positive and 
negative frequencies. We will avoid this terminology throughout and simply use power 
Spectrum or power-spectral density. 

For a white random process X(r) with power spectrum Se( f) = No/2, the autocorre- 
lation function R,(r) is 


oe | No pe 
R(t) -f SAP df = =f eT dp Msa (2.4.5) 
a Te Jeg) 2 


where 5{r) is the unit impulse. Consequently for all t 4 0, we have R,(t) = Ov ie., if 
we sample a white process at two points ż; and 2 (fi Æ t2), the resulting random variables 
will be uncorrelated. If, in addition to being white, the random process is also Gaussian, 
the sampled random variables will be statistically independent Gaussian random variables. 

ILLUSTRATIVE P BLEM 








Illustrative Problem 2.4 Generate a discrete-time sequence of N = 1000 i.i.d. uniformly 


distributed random numbers in the interval (—1, 3) and compute the autocorrelation of the 


sequence {X,,}, defined as ` 


Nom 
1 
Reim) = =D Xn Xnome m=0,1,..., M 
n=) 
l N 
= al DO XaXnems m= —1,-2,...,-M (2.4.6) 
azim 


Also, determine the power spectrum of the sequence {Xp} by computing the discrete Fourier 
transform (DFT) of R, (m). The DFT, which is effictently computed by use of the fast Fourier 
transform (FFT) algorithm, is defined as 


M 
S= JO Rmin EM+N 24.7) 
m=a—~M 


-eD 


The MATLAB script that implements the generation of the sequence {Xn}, the com- 
putation of the autocorrelation, and the computation of the power spectrum 8,(f) is given 
below. We should note that the autocorrelation function and the power spectrum exhibit a 
significant variability. Therefore, it is necessary to average the sample autocorrelation over 
several realizations. Figures 2.10 and 2.11 illustrate R,(m) and $x (f) obtained by running 
this program using average autocorrelation over 10 realizations of the random process, 
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al» — 


% MATLAB script for Hlustrative Problem 4, Chapter 2. 











echo on 

N=1000; 

M=50;, 

Rx-av=zeros(1,M+1), 

Sx-av=zeros(1,M+1), 

for j=1:10, % take the ensemble average over 10 realizations 
X=rand(4,N)—1/2; % N iid. uniformly distributed random variables 

% between -1/2 and 1/2 

Rx=Rx_est(X.M); % autocorrelation of the realization 
Sx=fftshift(abs(fit(Rx))); % power spectrum of the realization 
Rx_av=Rxav+RX; % sum of the autocorrelatios 
Sx-av=Sxav+Sx, % sum of the spectrums 

end, 

RxaveRx_av/10; % ensemble average autocorrelation 

$x-av=Sx.av/10; % ensemble average spectrum 


% plotting comments follow 




















Figure 2.10: The autocorrelation function in Illustrative Problem 2.4. 


A bandlimited random process X(t) has the power spectrum 


%, IflsB 


0, Ifl>B (2.4.8) 


S&S) = 


Let us determine its autocorrelation function. From (2.4.1) we have 
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Figure 2.11: The power spectrum in Illustrative Problem 2.4. 


8 N 
R,(t) af Beini ag 
-8 2 


ZNB sin 27 Bt 49 
TARD: Qn Br A 


Figure 2.12 illustrates R; (T). 
MATLAB may be used to compute R, (T) from $,(f) and vice-versa. The fast Fourier 
wansform (FFT) algorithm may be used for this computation. 


ILLUSTRATIVE PROBLEM 


Dlustrative Problem 2.5 Compute the autocorrelation R(t) for the random process whose 
power spectrum is given by (2.4.8). 


im SOLUTION 


To perform the computation, we represent S,(f) by N samples in the frequency range 
If] < B, with each sample normalized to unity. The result of computing the inverse FFT 
with X = 32 is illustrated in Figure 2.13. Note that we obtain only a coarse representation 
of the autocorrelation function R,(t), because we sampled S,(f) only in the frequency 
range |f| < B. The frequency separation in this example is Af = 2B/N. If we keep Af 
fixed and increase the number of samples by including samples for |f| > B, we obtain 
intermediate values of R,(t). Figure 2.14 illustrates the result of computing the inverse 
FFT with N, = 256 samples, of which N = 32 are unity. 
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Figure 2.13: Inverse FFT of the power spectrum of the bandlimited random process in 


Illustrative Problem 2.5 with 32 samples. 
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Figure 2.14: Inverse FFT of the power spectrum of the bandlimited random process in 


Illustrative Problem 2.5 with 256 samples. 


2.5 Linear Filtering of Random Processes 


Suppose that a stationary random process X (r ) is passed through a linear time-invariant filter 
that is characterized in the time domain by its impulse response A(r)and in the frequency 


domain by its frequency response 


Hf) = E heit dt 


-æ 


Tt follows that the output of the linear filter is the random process 


a 
Yo =f XOht = dr 
-œ 


The mean value of ¥ (t) is 


(2.5.1) 


(2.5.2) 


64 CHAPTER 2. RANDOM PROCESSES 


= | EIXO- dt 


=% 


x 
=m, f A(t —rt)dt 


æ 


~ 
=m f h(r)dt 


—90 


== m,H(0) (2.5.3) 
where H(0) is the frequency response H(f) of the filter evaluated at f = 0. 
The autocorrelation function of Y(t) is 
Ry(t) = E[Y(t) ¥(e+ )] 


œ poo 
=| J ELX(t)X (a) aCe — hit +r adr da 
-w Joe 


æ poo 
f | R(t —aya(t — daa +r- a)dr da (2.5.4) 
=% Joo 


In the frequency domain, the power spectrum of the output process Y(t) is related to the 
power spectrum of the input process X (1) and the frequency response of the linear filter by 
the expression 


Sf) = Se MIAO? (2.5.5) 


This is easily shown by taking the Fourier transform of (2.5.4). 
ILLUSTRATIVE PROBLEM 





Illustrative Problem 2.6 Suppose that a white random process X (t) with power spectrum 
S,(f) = l for all f excites a linear filter with impulse response 


ev", £20 
= = (2.5.6 
Be) 0. t<0 ) 


Determine the power spectrum Sy(f) of the filter output 


CD 


The frequency response of the filter is easily shown to be 


L 
= —— 5.7 
H(f) 1+ jinf (2.5.7) 
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Hence, 


SiD =i HÈ 
= l 
~ 1+ (Qxf)? 


The graph of S.{ f) is illustrated in Figure 2.15. The MATLAB script for computing 8y( f) 
for a specified Se f) and Hi f) is given below. 


(2.5.8) 


% MATLAB script tor Ilustrative Problem 6, Chapter 2. 
echo on 
deita=0.01; 





{=F_min-delta:F_max, 
Sx=ones( 1 lengthif) 
He1./(1#(2epiaf).°2); 
Sy=Sx.*H. "2: 
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f 
Figure 2.15: Plot of $,( f) given by (2.5.8). 





Blustrative Problem 2.7 Compute the autocorrelation function Ry(z) corresponding to 
Sy( f) in the Illustrative Problem 2.6 for the specified S+ (f) = 1. 





ED 


In this case, we may use the inverse FFT algorithm on samples of S,(f) given by (2.5.8). 
Figure 2.16 illustrates this computation with N = 256 frequency samples and a frequency 
separation Af = 0.1. The MATLAB script for this computation is given below. 


where X(n) = X (fa) are discrete-time values of the input random process and ¥(n) is the 
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output of the discrete-time filter. The mean value of the output process is 
[i 
1 


my = E[¥(n)] 








æ 
7 = SA ELXin = k)} 
% MATLAB script for Hlustrative Problem 7, Chapter 2. 
echo on k0 
N=256; % number of sumples 


deltaf=0.1; % frequency separation 
f=(O:deltaf:(N/2)adeltaf, —(N/2—1)xdeltaf -deltaf:—deltaf); 

% swap the first half 
Syat./(1H2epiet).”2); % sampled spectrum 
Ry=ifft(Sy); % autocorrelation of Y 
% plotting command follows 
plor(fftshft(real(Ry))), 


æ 
=m. Y Atk) 
k=0 


=m, H(0) (2.5.10) 


where H (0) is the frequency response H( f) of the filter evaluated at f =Oand 

















oo 
PS ; HIS) = $ hinein (2.5.11) 
=0 
ce The autocorrelation function of the output process is 
oora 
aon Ry(m) = E[{Y(n)Y (n + m)] 
omz œ œ 
= SV AAD EXO ~OXin +m ~D) 
oo k=0 1=0 
0.008 aa 
= JOPO ARR (m -1+ k) (2.5.12) 
coos | 1 k=0 i=0 
oos. The corresponding expression in the frequency domain is 
oom 
% = a a E SA) = SPEY (2.5.13) 


Figure 2.16: Plot of Ry(z) of Iltustrative Problem 2.7. where the power spectra are defined as 


æ 


= ~janfm 
Let us now consider the equivalent discrete-time problem. Suppose that a stationary Sf) = x Re(me (2.5.14) 
random process X (t) is sampled and the samples are passed through a discrete-time linear mae 
filter with impulse response h(n). The output of the linear filter is given by the convolution and 
sum formula 
oo 
G3 Sf) = Ry(m)e~ Pam (2.5.15) 
Y(n) = Sh) Xn — k) (2.5.9) oe 


k=O 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 2.8 Suppose that a white random process with samples {X(n)} is 
passed through a linear filter with impulse response 





0.95)" 
h(n) = {i )' n20 
0. n<0 


Determine the power spectrum of the output process {¥ (7}} 


<m 


It is easily seen that 


» 
HUA) = Dame Pa" 
=0 


æ 
= 0.95274" 
n=0 
1 
= 2.5.16 
1 — 0.95e7228/ ( ) 
and 
IHD? = ! 
|1 = 0.95e7}217 |? 
Ope St (2.5.17) 
1.9025 — 1.9 cos(2x f} 
Therefore, the power spectrum of the output process is 
SA) =H? Sef) (2.5.18) 
i (2.5.19) 


= T9025 — 1.9 cos(2x f) 


where we assumed $, (f) is normalized to unity. Figure 2.17 illustrates Sy(f). Note that 
5,(f) is periodic with period 27, The MATLAB script for this computation is given below. 





% MATLAB script for Illustrative Problem 8, Chapter 2. 
delta.w=2*pi/100, 

i:delta_w:pi; % one period of Sy 
Sy=1./(1.9025—1.9cos(w)); 
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3 2 7 v 7 2 a 


Figure 2.17: Plot of $, ( f) of Illustrative Problem 2.8. 


% plotting command foliows 
plot(w.Sy): 





The autocorrelation of the output process {Y(m)} may be determined by taking the 
inverse FFT of 8,(/). The student will find it interesting to compare this autocorrelation 
with that obtained in Illustrative Problem 2.3. 


2.6 Lowpass and Bandpass Processes 


Just as in the case of deterministic signals, random signals can also be characterized as 
lowpass and bandpass random processes. 


Definition: A random process is called lowpass if its power spectrum is targe in the vicinity 
of f = 0 and small (approaching 0) at high frequencies. In other words, a lowpass random 
process has most of its power concentrated at low frequencies. 

Definition: A lowpass random process X (t) is bandlimited if the power spectrum §,(f) = 0 
for | fi > B. The parameter B is called the bandwidth of the random process. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 2.9 Consider the problem of generating samples of alowpass random 
process by passing a white noise sequence {Xn} through a lowpass filter. The input sequence 
is an i.i.d. sequence of uniformly distributed random variables on the interval (-4, 4). The 
lowpass filter has the impulse response 
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(0.9)", n>0 


h = 
HD = bo n<0 


and is characterized by the input-output recursive (difference) equation 


Yn = 0.9 ynt + Xr, n>l, 





Compute the output sequence {yn } and determine the autocorrelation functions Re (m) and 
Ry (m), as indicated in (2.4.6). Determine the power spectra §,( f ) and S, ( f ) by computing 
the DFT of R,(m) and Ry (m). 


-e 


The MATLAB scripts for these computations are given below. Figures 2.18 and 2.19 
illustrate the autocorrefation functions and the power spectra. We note that the plots of 
the autocorrelation function and the power spectra are averages over 10 realizations of the 
random process. 








% MATLAB script for Hlustrative Problem 9, Chapter 2. 
N=1000; % the maximum value of n 


% Take the ensemble average ave 10 realizations 
% Generate a uniform number sequence an (-1/2.1/2) 


% Note that Yin} means Y{n-1) 






x-est(XM); % autocorrelation of {Xn} 
x.est(Y.M); % autocorrelation of {Yn} 
Sx=fftshift(abs(fEt(Rx))): % power spectrum of {Xn} 
Syafftshift(abs(fft(Ry))); % Power spectrum of {Yn} 
Rxav+Rx: 





Syav=Syav+Sy: 
end; 
Rxav=Rxav/10; 
Ryav=Ryav/10; 
Sxav=Sxav/10; 
SyaveSyav/10; 
% plotting commands follow 
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e 


function {Rx}=Rx es X M} 
So [Rx] = RxestX M) 








% RXEST Estimates the autocorrelation of the sequence of random 
% variables given in X. Only RafO), Rx(1), ... , Rx(M) are computed, 
% Note that Re(m) actually means Rx(n-1) 

Nalengeh(X); 

Rxszeros( 1.M+4): 

for m=1:M+1, 


for n=1N-m+1, 
Rx(m)sRx(m)+X(n)*X(n¢m—4); 
end, 
Rx(m)=Rxim)/iN-m+1), 
end; 

















Figure 2.18: Autocorrelation functions R,(m) and Ry(m) in Illustrative Problem 2.9. 


Definition: A random process is called bandpass if its power spectrum is large in a band of 
frequencies centered in the neighborhood of a central frequency + fo and relatively small 


outside of this band of frequencies. A random process is called narrowband if its bandwidth 
B & fo. 


Bandpass processes are suitable for representing modulated signals, In acommunication 
system, the information-bearing signal is usually a lowpass random process that modulates 
a carrier for transmission over a bandpass (narrowband) communication channel. Thus, the 
modulated signal is a bandpass random process. 


As in the case of deterministic signals, a bandpass random process X (t) can be repre- 
sented as 


X(t) = X(t) cos 2x fot — Xs (t) sin 2x fot (2.6.1) 
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Sef) 














Figure 2.19: Power spectra §,(f) and S,(f) in Illustrative Problem 2.9. 


where X,(t) and X,(t) are called the in-phase and quadratic components of X(t). The 
random processes X,.(¢) and X,(t) are lowpass processes. The following theorem, stated 
without proof, provides an important relationship among X(t), Xe(t) and X;(t). 
Theorem: If X (1) is a zero-mean stationary random process, the processes X,(t) and X;(t) 
are also zero-mean, jointly stationary processes. 


In fact, it can be easily proved (see [1]) that the autocorrelation functions of X,.(t) and X5(t) 
are identical and may be expressed as 
ReAt) = R(t) = Re(t} cos 2a fot + Rx (T) sin 2x for (2.6.2) 


where R,(r) is the autocorrelation function of the bandpass process X({r) and R,(t) is the 
Hilbert transform of R,(t), which is defined as 


20 
Rt) = if RO dt (2.6.3) 


e a i 
Also, the cross-correlation function of X¢(t) and X(t) is expressed as 
Res (t) = R(t) sin 27 fot — R(t) cos 27 fot (2.6.4) 
Finally, the autocorrelation function of the bandpass process X (t) is expressed in terms of 


the autocorrelation function Re (T) and the cross-correlation function Res(t) as 


Ry(t) = Ret) cos 2 fot — Res (t) sin 2x for (2.6.5) 
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ILLUSTRATIVE PROBLEM 


INustrative Problem 2.10 [Generation of samples of a bandpass random process) Gen- 
erate samples of a bandpass random process by first generating samples of two statistically 
independent random processes X(t) and X, (r) and using these to modulate the quadrature 
carriers cos 27 fy? and sin 27 fot, as shown in Figure 2.20. 








cos 2m fyt 
WGS filter 
XAt) cos 2a fyt 
=X, sin r fyt 
5 Lowpass 
Woy filter 

















sin 2r fot 


Figure 2.20: Generation of a bandpass random process. 


< 


On a digital computer samples of the lowpass processes X, (t) and X, (t) are generated 
by filtering two independent white noise processes by two identical lowpass filters. Thus, 
we obtain the samples X.(n) and X, (7n). corresponding to the sampled values of X,(r) and 
X; (0). Then, X,(n) modulates the sampled carrier cos 27 fonT and X,(n) modulates the 
quadrature carrier sin 27 fonT, where T is the appropriate sampling interval. 

The MATLAB script for these computations is given below. For illustrative purposes, 
we have selected the lowpass filter to have a transfer function 





1 
H@ = praa 





Also, we selected T = | and fo = 1000 The resulting power spectrum of the bandpass 
process is shown in Figure 2.21. 








% MATLAB script for Ilustrative Problem 10, Chapter 2. 
N=1000: % number of samples 
for i=1:2:N. 
[XIG) X1G#1)]=gngauss; 
[X2()_X2(i+1)]}=gngauss: 
end; % standard Gaussian input noise processes 
A=[1 —0.9]; % lowpass filter parameters 
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B=1, 
Xcsfilter(B.A, XI); x 
kter(B.A,X2). 






000/pi: % carrier frequency 
for i=1:N, 

band_pass_process(i)=Xe(i)#cos(2+piatcai)—Xsti}esin(2epietcxi: 
end: % T=! is assumed 
% determine the autocorrelation und the spectrum of the bandpass process 
M=50; 


bpp-autocorr=Rx-est(band_pass_process.M); 
bpp-spectrumsfftshifi¢absttft(bpp-autocorr))); 
% ploting commands follow 














to 











as wa aE w ™ Pr w a aes 


Figure 2.21: The power spectrum of the bandpass process in Illustrative Problem 2.10. 
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Problems 


2.1 Generate a set of 1000 uniform random numbers in the interval {O, 1] using the MAT- 
LAB function rand(1, N) function. Plot the histogram and the probability distribution 
function for the sequence. The histogram may be determined by quantizing the interval 
in 10 equal-width subintervals covering the range (0, 1] and counting the numbers in each 
subinterval. 


2.2 Generate a set of 1000 uniform random numbers in the interval {=}. $] using the 
MATLAB function rand(1, N). Plot the histogram and the probability distribution function 
for the sequence. 


2.3 Generate a set of 1000 uniform random numbers in the interval [-2, 2] by using the 
MATLAB function rand(1, N). Plot the histogram and the probability distribution function 
for the sequence. 


2.4 Generate a set of 1000 random numbers having the linear probability density function 


3, Osx<2 


0, otherwise 
Plot the histogram and the probability distribution function. 


2.5 Generate a set of 1000 Gaussian random numbers having zero mean and unit variance 
using the method described in Section 2.2. Plotthe histogram and the probability distribution 
function for the sequence. In determining the histogram, the range of the random numbers 
may be subdivided into subintervals of width a ?/5, beginning with the first interval covering 
the range —a7/10 < x < 07/10, where ø? is the variance. 


2.6 Generate a set of 1000 Gaussian random numbers having zero mean and unit vari- 
ance by using the MATLAB function randn(1, N). Plot the histogram and the probability 
distribution function for the sequence, Compare these results with the results obtained in 
Problem 2.5. 


2.7 Generate 1000 pairs of Gaussian random numbers (x1. x2) that have mean vector 


and covariance matrix 
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a. Determine the means of the samples (x1;, x3), i = 1,2.... , 1000 defined as 
> 1 1000 
™\ = T000 2 li 
7 1 {000 
m= T000 X 


Also, determine their variances, 





a2 
ai 
-2 
gi = 
and their covariance, 
1000 
ey = Tooo Yeu = Axa — 2) 
tel 


b. Compare the values obtained from the samples with the theoretical values. 


2.8 Generate a sequence of 1000 samples of a Gauss-Markov process described by the 
recursive relation 


Xn = pXn-1+ Wa, 2 =1,2,..., 1000 


where Xp = 0, p = 0.9, and {W,} is a sequence of zero-mean and unit variance i.i.d. 
Gaussian random variables. 


2.9 Repeat Illustrative Problem 2.4 with an i.id. sequence of zero-mean, unit variance, 
Gaussian random variables. 


2.10 Repeat Illustrative Problem 2.5 when the power spectrum of a bandlimited random 
process is 


1 <B 
san-l, A. ifis 


otherwise 


2.41 Repeat Illustrative Problem 2.6 with a linear filter that has impulse response 


e”, t20 
O= jo r20 
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2.12 Determine numerically the autocorrelation function of the random process at the output 
of the linear filter in Problem 2.11. 


2.13 Repeat Illustrative Problem 2.8 when 


h(n) = (0.3)", n>0 
0, n<O 


2.14 Generate an i.i.d. sequence {xn} of N = 1000 uniformly distributed random numbers 
in the interval [— $. 3l This sequence is passed through a linear filter with impulse response 


h = 
mt <0 


ae 


The recursive equation that describes the output of this filter as a function of the input is 
Yn = 0.95 yn- + Xn. n20, y-1=0 


Compute the autocorrelation functions R, (m) and Ry(m) of the sequences {xn} and {yn} 
and the corresponding power spectra S, (f) and S,(f) using the relations given in (2.4.6) 
and (2.4.7), Compare this result for S,(f) with that obtained in Wlustrative Problem 2.8. 


2.15 Generate two i.i.d. sequences {wen} and {wen} of N = 1000 uniformly distributed 
random numbers in the interval [— 4, 31. Each of these sequences is passed through a linear 
filter with impulse response 
Ly" ons 
hia) = { . n20 


0, n<0 


whose input-output characteristic is given by the recursive relation 


Xa = 3*n-I + Wa. n>l,x=0 
Thus, we obtain two sequences. {xq} and {xsn}. The output sequence {Xen} modulates 
the carrier cos(7/2)n, and the output sequence {x;,} modulates the quadrature carrier 
sin(x /2)n. The bandpass signal is formed by combining the modulated components as in 
(2.6.1). 

Compute and plot the autocorrelation components R,(m) and R;(m) for |m] < 10 for 
the sequences {xon} and (x;n}, respectively. Compute the autocorrelation function R,(m) 
of the bandpass signa! for |m| < 10. Use the DFT (or the FFT algorithm) to compute 
the power spectra Se( f). Ss(f) and S,(f). Plot these power spectra and comment on the 
results. 


Chapter 3 


Analog Modulation 


3.1 Preview 


In this chapter we will study the performance of various analog modulation-demodulation 
schemes, both in the presence and in the absence of additive noise. Systems studied in this 
chapter include amplitude-modulation (AM) schemes, such as DSB-AM, SSB-AM, and 
conventional AM, and angle-modulation schemes, such as frequency and phase modulation. 
Each member of the class of analog modulation systems is characterized by five basic 
properties: 


1. Time-domain representation of the modulated signal; 

2. Frequency-domain representation of the modulated signal; 
3. Bandwidth of the modulated signal; 

4. Power content of the modulated signal; 

5. Signal-to-noise ratio (SNR) after demodulation. 


These properties are obviously not independent of each other. There exists a close rela- 
tionship between time- and frequency-domain representations of signals expressed through 
the Fourier transform relation. Also, the bandwidth of a signal is defined in terms of its 
frequency characteristics. 

Due to the fundamental difference between amplitude- and angle-modulation schemes, 
these schemes are treated separately and in different sections. We begin this chapter with 
the study of the simplest modulation scheme, amplitude modulation. 


3.2 Amplitude Modulation (AM) 


Amplitude modulation (AM), which is frequently referred to as linear modulation, is the 
family of modulation schemes in which the amplitude of a sinusoidal carrier is changed 
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as a function of the modulating signal. This class of modulation schemes consists of 
DSB-AM (double-sideband amplitude modulation), conventional amplitude modulation, 
SSB-AM (single-sideband amplitude modulation), and VSB-AM (vestigia!-sideband am- 
plitude modulation). The dependence between the modulating signal and the amplitude of 
the modulated carrier can be very simple, as, for example, in the DSB-AM case, or much 
more complex, as in SSB-AM or VSB-AM. Amplitude-modulation systems are usually 
characterized by a relatively low bandwidth requirement and power inefficiency in com- 
parison to the angle-modulation schemes. The bandwidth requirement for AM systems 
varies between W and 2W, where W denotes the bandwidth of the message signal. For 
SSB-AM the bandwidth is W, for DSB-AM and conventional AM the bandwidth is 2W, 
and for VSB-AM the bandwidth is between W and 2W. These systems are widely used in 
broadcasting (AM radio and TV video broadcasting), point-to-point communication (SSB), 
and multiplexing applications (for example, transmission of many telephone channels over 
microwave links). 


3.2.1 DSB-AM 


In DSB-AM, the amplitude of the modulated signat is proportional to the message signal. 
This means that the time-domain representation of the modulated signal is given by 


u(t) = Amt) cos(27 fet) 3.2.1) 
where 
c(t) = Ac cos(2x fet) (3.2.2) 


is the carrier and m(t) is the message signal. The frequency-domain representation of 
DSB-AM signal is obtained by taking the Fourier transform of u(t) and results in 


i Ac 
U(f\= iMg- fa + FEMS + fo (3.2.3) 


where M (f) is the Fourier transform of m(t). Obviously, this type of modulation results in 
a shift of +f, and a scaling of pa in the spectrum of the message signal. The transmission 
bandwidth denoted by Br is twice the bandwidth of the message signal: 


By =2W (3.2.4) 


A typical message spectrum and the spectrum of the corresponding DSB-AM modulated 
signal are shown in Figure 3.1. 
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a M) 


-W I w 











Figure 3.1: Spectrum of DSB-AM modulated signal. 


The power content of the modulated signal is given by 








TR, 
P, = lim = ur(t)dt 
Too I J-rn 
TIE i 5 
= lim = Azm“ {t) cos” (27 fit) dt 
Too T/2 
i ie 4; 
= lim = Am E ESÉEAD gy 
T>œT Jorn 2 
1 TR m2 1 T/2 4: 
snl tim tO ae tim bP my a 
ToT J-rn 2 T+o0T J-rn 2 
T/2 
= A? lim Si ne Oa (3.2.5) 
€T T Sir 
Al 
= > Pm (3.2.6) 


where Pm is the power content of the message signal and Equation (3.2.5) follows from the 
fact that m(r) is a lowpass signal with frequency contents much less that 2 f, the frequency 
content of cos(4z fet); therefore, the integral 


T/2 
f miq SEAD ge 82.7) 
-7/2 2 


goes to zero as T —> 20. Finally, the SNR for a DSB-AM system is equal to the baseband 
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SNR; i.e., itis given by 


5 PR 
ih LN 3.2.8 


where Pa is the received power (the power in the modulated signal at the receiver), %2 is 
the noise power spectral density {assuming white noise), and W is the message bandwidth. 
ILLUSTRATIVE PROBLEM 


Illustrative Problem 3.1 (DSB-AM modulation] The message signal m(t) is defined as 
l Osr<# 


7 
mlt) = {—2, fe<r< 


0, otherwise 


This message DSB-AM modulates the carrier c(t) = cos 27 fet, and the resulting modulated 
signal is denoted by u(t). It is assumed that 9 = 0.15 s and fe = 250 Hz. 


l. Obtain the expression for u(t). 
2. Derive the spectra of m(t) and u(t). 


3. Assuming that the message signal is periodic with period Ty = fo, determine the 
power in the modulated signal. 


4, If a noise is added to the modulated signal in part (3) such that the resulting SNR is 
10 dB, find the noise power. 


SE $$ _$_§_i—_———_— 


1. m(t) can be written as m(t) = N (£) - 2n ( aun), therefore, 


t — 0.025 t — 0.075 
u(t) = [n (cS) - 271 (GE) cos(500xt) (3.2.9) 


2. Using the standard Fourier transform relation F [M(¢)] = sinc(r} together with the 
shifting and the scaling theorems of the Fourier transform, we obtain 


. t 
F[m(t)} = a | af) - 25e sine ( of 
= Berion sine ( af) (1 — 2¢~ 127013) (3.2.10) 
3° 


Substituting fo = 0.15 s gives 


Fm(t)] = 0.05e7% sinc(0.05 f) (1 — 270- LiaS ) (3.2.11) 
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For the modulated signal u(t} we have 


U(f) = 0.025e79 5/2 fe) sine (0.05(f — f.)) (1 — fee) 


+ 0.0256? ITU + sinc (O.05(f + f.)) (1 — 260 UALS ue) 


Plots of the magnitude of the spectra of the message and the modulated signals are 
shown in Figure 3.2. 











Figure 3.2; Magnitude spectra of the message and the modulated signals in Iltustrative 
Problem 3.1. 


3. The power in the modulated signal is given by 


At I 


where Pnn is the power in the message signal; 


2t0/3 åt 
Pa == f m(t) dt = ~ (3458) = 5 = 1.666 
fo 


and 


Here 


Pr 
10logig (= rE) = 10 
A 


or Pr = P, = 10P,, which results in Pa = P,/10 = 0.0833. 
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The MATLAB script for the above problem follows. 


e 


% dsbl.m 
% Matlab demonstration script for DSB-AM modulation. The message signal 
% is +l for 0 < 1 < 10/3, -2 for 10/3 < t < 210/3 and zero otherwise, 














echo on 
10=.15; % signal duration 

001; % sampling interval 

50; % carrier frequency 
snr=20; % SNR in dB (loguruhmic) 

1/15; % sampling frequency 

3, % desired freq. resolution 
t=(O:t8:10}; % time vector 
snt_lin=10*(sne/10), % linear SNR 


% message signal 
=[ones( 1 t0/(Sats)), -2nones( t 0/( Sets). zeros 1 ,10/(3ets)+1)); 













sl 2epixic.xt), % carrier signal 

cy % modulated signal 
(M,m.dfl J=ffiseq(m.ts.df); % Fourter transform 
M=M/fs; % scaling 
{U.u.dfl J=fftseq(u.ts.df), % Fourier transform 
UsU/ts: % scaling 
(C.c.dfl Jafftseq(c.ts.df); % Fourier transform 
f= [0-dfl:dfl «(length(m)—1)]-fs/2; % freq. vector 
signal_power=power(u( -length())); % power in madulated signal 
noise-power=signal..power/snr-lin; % Compute noise power 
noise_std=sqri(noise_power): % Compute noise standard devianon 
noise=noisestd#randn(1 length(u)); % Generate naise 
reutnoise; % Add noise ta the modulated signal 
[R.c.dfl]=fftseq(r.ts.d£); % spectrum of the signul+noise 
R=R/fs; % scaling 


pause % Press a key t show the modulated signal power 

signal_power 

pause % Press any key to see a plot of the message 

elf 

subplot(2,2,1) 

plot(t.m(1 :length(t))) 

xlabel(‘ Time’) 

ütle(' The message signal’) 

pause % Press any key tw see a plot of the carrier 

subplot{2,2,2) 

plot(t,e(1slength(t))) 

xlabel(‘ Time’) 

title(' The carrier’) 

pause % Press any key ta see a plot of the modulated signal 

subplot(2,2,3) 

plot(t,u( 1 :length(t))) 

xlabel(' Time’) 

title(’The modulated signal’) 

pause % Press uny key ta see a plots of the magnitude of the message und the 
% modulated signal in the frequency domain, 

subplot(2.1,1) 

plot(f,abs(fftshift(M))) 

xlabel(‘ Frequency’) 
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titlet’ Spectr: 
subptot(2.1,2) 

plotéf.abs(ffishy 
title(‘ Spect. 















pause % Press u key to see a noise sample 
subplot(2,1,1) 
plot(t,noiser tle 
title( ‘noise s: 
xlabel( ‘7 ir 
pause % Press a key w see the modulated signal and noise 
subplot(2,1,2) 

plotit.r Tlengthit))) 
tite’ Signal and no 
xlabel( Time’) 

pause % Press a key to see the mududated signal and nuse m freq. domam 
sudptot(2.1,1) 

plot(fabsiffishin Uy) 

ntle(‘ Signal spectrum’) 




















subplot(2. 1.2) 
plot f.abs(ffishift(R })) 


titlef’ Signal a 
xlabel( Frequenc: 





noise spectrum’) 


, 








ILLUSTRATIVE PROBLEM 


Illustrative Problem 3.2 [DSB modulation for an almost bandtimited signal] The mes- 
sage signal m(t) is given by 


sinc(1007). |t| < to 
i otherwise 


mí) = 


where f9 = 0.1. This message modulates the carrier c(t) = cos(2x fet), where fe = 250 
Hz. 


1. Determine the modulated signal u{r). 
2. Determine the spectra of m(t) and u(t) 


3. If the message signal is periodic with period To = 0.2, s determine the power in the 
modulated signal. 


4. If a Gaussian noise is added to the modulated signal such that the resulting SNR is 
10 dB. find the noise power. 
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1. We have 


u(t) = m(t)c(t) 
sinc(100r) cos(500r), p| < 0.1 
0, otherwise 


= sinc((00r) N (5r) cos(S00r) (3.2.13) 


(3.2.12) 


A plot of the spectra of m(t) and u(r) is shown in Figure 3.3. 
As the figure shows, the message signal is an almost bandlimited signal with a band- 
width of 50 Hz. 


2. The power in the modulated signal is half of the power in the message signal. The 
power in the message signal is given by 





1 pol 3 
f sine” (100t) dr 
. 1 


The integral can be computed using MATLAB’s quad8.m m-file, which results in 
Pm = 0.0495 and, hence, Py = 0.0247. 


3. Here 


10logig (3) = 10 => P, = 0.1 Pg =0.1Py = 0.00247 
'n 


The MATLAB script for the above problem follows. 


-mn a 


% dsb2.m 

% Matlab demonstration script for DSB-AM modulation. The message signal 

% is mit) = sinc 1001). 

echo on 

(0=.2; % signal duration 

% sampling interval 

% carrier frequency 

% SNR in dB (logarithmic) 
% sampling frequency 

% required freq. resolution 








t=(~10/2:t8::0/2]; % time vector 

sor-lin=10" (snr/10); % linear SNR 

me=sinc(100xt); % the message signal 
c=cos(2+pixfc.at); % the carrier signal 

u=m.#c; % the DSB-AM modulated signal 
[M.m.dfl}=fftseq(m,ts,df); % Fourier transform 

M=M/fs; % scaling 


(U,u.dfl |=fitseq(u.ts,df); % Fourier transform 
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Figure 3.3: Spectra of the message and the modulated signals in Illustrative Problem 3.2, 
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UsU/fs; % scaling 

f=[O:dfl:dfl x(length(m)—1)}—-f5/2: % frequency vector 
signal_power=power(u(:length(t))): % compute modulated signal power 
noise-power=signal.power /snr-lin; % Compute noise power 
noise_std=sqrt(noise power); Se Compute noise standard deviation 
noise=noise -std+randn( 1 length(w)); % Generate noise sequence 
r=usnoise; % Add noise 10 the modulated signal 
(R,rdfl J=fftseq(rts.df), % Fourier transform 

ReR/fs; % scaling 


pause % Press a key w show the modulated signal power 

signal_power 

pause %Press any key tu see a plot of the message 

elf 

subplot(2.2,1) 

plot(t.m(1 :length(t))) 

xlabel(‘ Time‘) 

tide(' The message signal’) 

pause % Press any key to see a plot of the carrier 

subplot(2,2,2) 

plorit.c( 1 :length(«))) 

xtabel( ’ Time‘) 

tide("The carrier’) 

pause % Press any key to see a plot of the modulated signal 

subplot(2,2,3) 

plot(t.u(t:length(t))) 

xlabel(“ Time‘) 

title(‘The modulated signal’) 

pause % Press any key tu see a plot of the magnitude of the message and the 
% modulated signal in the frequency domain. 

subplot(2.1,1) 

plot(f.abs(fftshift(M))) 

xlabel{ ' Frequency’) 

title(’ Spectrum of the message signal’) 

subplot(2.1.2) 

plot(fabs(ffeshift(U))) 

title(‘ Spectrum of the modulated signal’) 

xlabel(’ Frequency‘) 

pause % Press u key w see a noise sample 

subplot(2,1,1) 

plor(t.noise( length(t))) 

title(‘noise sample’) 

xtabel( ‘Time’ ) 

pause % Press a key to see the modulated signal and noise 

subplot(2,1,2) 

plot(t.e(1 clength(t))) 

tide(‘Signal and noise’) 

xlabel(' Time’) 

pause % Press a key to see the modulated signal and noise in freq. domain 

subplot(2,1.1) 

plot(f,abs(fftshift(U))) 

tile(’ Signal spectrum’) 

xlabel(‘ Frequency’) 

subplot(2,1,2) 

plot(f.abs(fftshift(R))) 

tide(’ Signal and noise spectrum’) 

xlabel(’ Frequency‘) 
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What happens if the duration of the message signal fo changes; in particular, what is the 
effect of having large fo’s and small fo’s? What is the effect on the bandwidth and signal 
power? 


The m-file dsb_mod.m given below is a general DSB modulator of the message signal 
given in vector m on a carvier of frequenc] 








function u=dsb_mod(m,ts,fc) 

% u = dsb modtm.isfe) 

WDSBMOD akes signul m sumpled at ts and carrier 

Jreq. fe as input and returns the DSB modulated 
signal. is << 1/2fc. The modulated signal 

is normalized to huve half the message power, 
the message signal starts at O. 


RRRA 





t=[Olength(m)~ jets; 
u=m.scos(2+pie0), 





3.2.2 Conventional AM 


In many respects conventional AM is quite similar to DSB-AM; the only difference is that 
in conventional AM, m(t) is substituted with [1 + am,(t)], where m,(t) is the normalized 
message signal (i.e., |mn(t}| < 1). and a is the index of modulation, which is a positive 
constant between 0 and 1. Thus we have 


u(t) = Ac [1 + amy (t)] cos(2z fet) (3.2.14) 
and 


up = feg — fe) +aMn(f — fA +E + fe) +aMalf t+ fed) (3.2.15) 


The net effect of scaling the message signal and adding a constant to it is that the term 
[1 tam, (t)} is always positive. This makes the demodulation of these signals much easier 
by employing envelope detectors. Note the existence of the sinusoidal component at the 
frequency f, in U(f). This means that a (usually substantial) fraction of the transmitted 
power is in the signal carrier that does not really serve the transmission of information. This 
fact shows that compared to DSB-AM, conventional AM is a less economical modulation 
scheme in terms of power utilization. The bandwidth, of course, is equal to the bandwidth 
of DSB-AM and is given by 


Br =2W (3.2.16) 


Typical frequency-domain plots of the message and the corresponding conventional AM 
signal are shown in Figure 3.4. 
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Figure 3.4: Spectrum of conventional AM. 


The power content of the modulated signal, assuming that the message signal is a zero- 
mean signal, is given by 


2 
P= = [r+a?e,,] (3.2.17) 


which comprises two parts, a which denotes the power in the carrier, and a? Pan which 
is the power in the message-bearing part of the modulated signal. This is the power that 
is really used to transmit the message. The ratio of the power that is used to transmit the 
message to the total power in the modulated signal is called the modulation efficiency and 
is defined by 


a? Pa, 


= Trap G218) 


n 
Since Imp (t)| < Landa < 1, we always have n < 0.5. In practice, however, the value of 
n is around 0.1. The signal-to-noise ratio is given by 


SN Ep ER, 2.19) 
Gq), "NOW 0:219) 


where y is the modulation efficiency. We see that the SNR is reduced by a factor equal to 7 
compared to a DSB-AM system. This reduction of performance is a direct consequence of 
the fact that a significant part of the total power is in the carrier (the deltas in the spectrum), 
which does not carry any information and is filtered out at the receiver. 
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ILLUSTRATIVE PROBLEM 


Ulustrative Problem 3.3 [Conventional AM] The message signal 





l O<<# 
m= 4-2, Ber < 
0. otherwise 


modulates the carrier c(t) = cos(27 fet) using a conventional AM scheme. It is assumed 
that fe = 250 Hz and t = 0.15; the modulation index is a = 0.85, 


1. Derive an expression for the modulated signal. 
2. Determine the spectra of the message and the modulated signals. 


3. Ifthe message signal is periodic with a period equal to fo, determine the power in the 
modulated signal and the modulation efficiency. 


4. Ifa noise signal is added to the message signal such that the SNR at the output of the 
demodulator is 10 dB, find the power content of the noise signal, 


ame SOLUTION J 


1. First note that max |m(z)} = 2; therefore, my(t) = m(t)/2. From this we have 





u(t) = |: +0852 Jooss 


r — 0.025 t — 0.075 
= 4 ——— } -0. —_— 
£ + 0.42511 ( 0.05 ) 0.850 ( 005 )] cos{5007t) 


2. A plot of the message and the modulated signals is shown in Figure 3.5. 


3. For the message signal we have 
Fimti) = 0.05e-9°/71 sinc(0.05 f)(1 ~ 2079 inf) (3.2.20) 
and for the modulated signal 
Uf) = 0.010625¢~9 95/4250) Sinc(0.05( f — 250))(1 Qe OA =D) 


+ 0.010625672941 +250 sinc(Q.O5(F + 250) (1 = 2e lunts250) 


Plots of the spectra of the message and the modulated signal are shown in Figure 3.6. 


Note that the scales on the two spectra plots are different, The presence of the two 
delta functions in the spectrum of the modulated signal is apparent. 
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Figure 3.5: The message and the modulated signals in Illustrative Problem 3.3. 


4. The power in the message signal can be obtained as 


1 0.05 0.1 
Pm = — asaf dt | = 1.667 
0.15 f 0.05 


The power in the normalized message signal Pm, is given by 


l 1.66 





Pa, = -Pa = Sa = 0.4167 
and the modulation efficiency is 
a Pn, 0.85? x 0.4167 


= 0.2314 





T= Yay, +085? x 0.4167 


The power in the modulated signal is given by (E denotes the expected value) 
Ab 
P= SEN + am, (t)? 


1 0.025 
1 (1403010 -1.7 x ——= 
2 (: ha a y 


i 


= 0.5088 


5. In this case 


or 
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Figure 3.6: Spectra of the message and the modulated signals in Illustrative Problem 3.3. 
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Substituting n = 0.2314 and Pg = P, = 0.5088 in the above equation yields 
Px 
Pa = 1 = 0.0118 





In finding the power in the modulated signal, in this problem we could not use the 
relation 


à 
E 


Pu = [1 +a? Pn] 


because in this problem m(t) is not a zero mean signal. 
The MATLAB script for this probiem is given below. 





% umm 

% Matlab demonstration script for DSB-AM modulation. The message signal 
% is +I for O < t < 10/3. -2 for 10/3 < t < 210/3 and zero otherwise. 
echo on 


% signal duration 

% sampling interval 

% carrier frequency 

% SNR in dB {logarithmic 
% modulation index 

% sampling frequency 

% time vector 

2: % required frequency resolution 
sar.lin=407(snr/10); % SNR 

% message signal 

me=fones(1 t0/(3ats)),—2eones( 1 .t0/(3ats)), zeros(1,10/(3+ts)+1)]; 
cxcos(2epiatc.et); % carrier signal 
m_n=m/max(abs(m)); normalized message signal 
(M.mdfl J=fftseq(m.ts.40); Fourier transform 
M=M/fs; scaling 

df df «(length(m)—1)]—fs/2: frequency vector 
u=(14a9m_n).ec; modulated signal 

[U.u.dfl J=fftseq(u.ts.df); Fourier transform 
UsU/fs, sealing 
signal_power=power(u({ :length(t))); power in modulated signal 
% power in normalized message 
pmn=power(m(1:length(t}))/(max(abs(m)))* 2: 











RAMA AARRKZRA 


e1a=(a~2«pmn)/(1+a7 2spmn): % modulation efficiency 
noise_power=etassignal_power/snr_lin; % noise power 
noise.std=sqrt(noise power): % noise standard devianon 
noise=noise_stderandn(1 length(u)); % yenerute noise 
r=u+noise; % Add noise to the modulated signal 
{R.r.dfl J=fftseq(s,ts,af), % Fourier transform 
RER/fs; % scaling 

pause % Press a key to show the modulated signal power 
signal_power 

pause % Press u key to show the modulation efficiency 

eta 

pause % Press any key to see a plot of the message 

subplot(2,2,1) 
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plot(t.m(1lergth(1))) 

axis((0 0.15 —2.1 2.1]) 

xlabel(‘ Time) 

lile(" The message sign 

pause 

pause % Press any key 10 see a plot of the carrier 

subplot(2,2.2) 

plotit.c(1:lengthit))) 

axis({0 0.15 -2.1 2.11) 

xlabel( ‘Time’ ) 

title(‘ The carrier’) 

pause % Press any key tw see a plot of the modulated signal 

subplon2.2.3) 

plot((.u(1 length(t))) 

axist[0 0.15 -2.1 2.1]) 

xlabel(‘ Time’) 

title(‘The modulated signal’) 

pause % Press uny key to see a plots of the magnitude of the message und the 
% modulated signal in the frequency domain. 

subplot(2,1.1) 

plot(f,abs(fftshift(M))) 

xlabel(‘ Frequency’) 

tilet’ Spectrum of the message signal’) 

subplot(2.1,2) 

plor(fabs(fishift(U))) 

title(" Spectrum of the modulated signal’) 

xlabel{" Frequency’) 

pause % Press a key to see a noise sample 

subplot(2.1.1) 

plot(t,noise(t:length(t))) 

tide( noise sampie’) 

xlabel(“ Time‘) 

pause % Press a key to see the modulated signal and noise 

subplot(2.1,2) 

plottc.r(1 tength(e))) 

title(" Signal and noise’) 

xlabel{" Time’) 

pause % Press a key to see the modulated signal und noise in freq. domain 

subplot(2.1.1) 

plot(fabs(ftshift(U))) 

tille(‘ Signal spectrum’) 

xlabel(‘ Frequency’) 

subplot{2,1.2) 

plot(f.abs(fftshift(R))} 

tile(‘ Signal and noise spectrum’) 

xlabel{ * Frequency‘) 





) 








The MATLAB m-file am_mode.m given below is a general conventional AM modulator, 





function a=am_mod(a,m,ts, fc) 


% u = ammod{a.m.ts fc) 
AMMOD takes signal m sampled at is and carrier 
% freq. fe us input and returns the AM modulated 


% signal, “a” is the modulation index 
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% and ts << 1/2fe. 


t=[O-length(m)~t}+1s; 
cxcos(2xpisfc.4t); 
m.n=m/max(abs(m)); 
ue(1+a4m_n).4c: 





3.2.3 SSB-AM 


SSB-AM is derived from DSB-AM by eliminating one of the sidebands. Therefore, it 
occupies half the bandwidth of DSB-AM. Depending on the sideband that remains, either 
the upper or the lower sideband, there exist two types of SSB-AM, USSB-AM and LSSB- 
AM. The time representation for these signals is given by 

A 
128 
where the minus sign corresponds to USSB-AM and the plus sign corresponds to LSSB-AM. 
The signal denoted by zñ (r) is the Hilbert transform of m(t). defined by m(r) = m(t) « d 
or, in the frequency domain, by M(f) = —j sen(f)M(f). In other words, the Hilbert 
transform of a signal represents a 7t /2 phase shift in all signal components. In the frequency 
domain, we have 





ut) = Emcor fet) F (t sin(27 fet) (3.2.21) 


MIS- JAME +f FLIS 
Uussg( f) = h hanis (3.2.22) 
and 
(M(f-fI+MF+ fl. Ifl sf 
Utssa(f) = iH ; EEREN (3.2.23) 


Typical plots of the spectra of a message signal and the corresponding USSB-AM modulated 
signal are shown in Figure 3.7. 

The bandwidth of the SSB signal is half the bandwidth of DSB and conventional AM 
and so is equal to the bandwidth of the message signal, i.e., 


Br =W (3.2.24) 
The power in the SSB signal is given by 
A? 
R= 4 Pn (3.2.25) 


Note that the power is half of the power in the corresponding DSB-AM signal, because one 
of the sidebands has been removed. On the other hand, since the modulated signal has half 
the bandwidth of the corresponding DSB-AM signal, the noise power at the front end of 
the receiver is also half of a comparable DSB-AM signal, and therefore the SNR in both 


systems is the same; i.e., 
($) FER (3.2.26) 
o 
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Figure 3.7: Spectra of the message and the USSB-AM signal. 


ILLUSTRATIVE PROBLEM 





Illustrative Problem 3.4 (Single-sideband example} The message signal 


1 Ost<} 
m1) = {-2, wer< 4 


0. otherwise 


modulates the carrier c(t) = cos(2x f-t) using an LSSB-AM scheme. It is assumed that 
fg = 0.15 sand f = 250 Hz. 


1. Plot the Hilbert transform of the message signal and the modulated signal u(r). 
2. Find the spectrum of the modulated signal. 


3. Assuming the message signal is periodic with period tp, determine the power in the 
modulated signal. 


4. If a noise is added to the modulated signal such that the SNR after demodulation is 
10 dB, determine the power in the noise. 


ECOLO T ON 


1. The Hilbert transform of the message signal can be computed using the Hilbert 
transform m-file of MATLAB, i.e., hilbert.m. It should be noted, however, that this 
function returns a complex sequence whose real part is the original signal and whose 
imaginary part is the desired Hilbert transform. Therefore, the Hilbert transform of 
the sequence m is obtained by using the command imag(hilbert(m)). 
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Now, using the relation 
u(t) = m(t) cos(2r fet) + m(r) sin ft) (3.2.27) 


we can find the modulated signal. Plots of s(t) and the spectrum of the LSSB-AM 
modulated signal u(r) are shown in Figure 3.8. 














7 a a mi be ae a ar ad 


Figure 3.8: Hilbert transform and the spectrum of the LSSB-AM modulated signal for m(t). 


2. The power in the message signal is 


0.15 


l m?(t) dt = 1.667 


Pa = 


0.15 





and therefore 





3. The post-demodulation SNR is given by 


P 
10 10g; (2) =10 
njo 


Hence, P, = 0.1 Pr = 0.1 P, = 0.0416. 


The MATLAB script for this problem follows. 


aama 
% Issbm 

% Matlab demonstration script for LSSB-AM modulation. The message signal 

% is +1 for 0 < t < 10/3, -2 for 10/3 < 1 < 210/3 and zero otherwise. 

echo on 
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signal duration 
sampling interval 
carrier frequency 

SNR in dB {logarithmic} 
% sampling frequency 

% desired freq. resolution 
t={0:ts:t0]; % time vector 
sar_tin=107(snr/10); % SNR 

% the message vector 

me=fones(1.t0/(3+ts)),~2eones( 1,10/(3ets)),zeros( 1 10/(3xts)+1)}; 
c=cos(2epiefc.xt), % carrier vector 


% 
k 
% 
% 


udsb=m. +c; % DSB modulated signal 
[UDSB,udssb.df 1 J=fftseq(udsb.ts,df); % Fourier transform 
UDSB=UDSB/fs: % scaling 

f=[0:df1:df1 «(length(udssb)—1)]—f5/2; % frequency vector 


n2=ceil(fe/dfl); 
% remove the upper sideband from DSB 
UDSB(n2:length(UDSB)—n2}=zeros(size( UDSB(n2:length(UDSB)—n2))); 


% location of carrier in freq. vector 


ULSSB=UDSB, % generate LSSB-AM spectrum 
[M.m.¢fl ]=fftseq(m.s,df), % Fourier transform 

M=M/fs; % scaling 

usreal(iff(ULSSB))«fs: % Generate LSSB siynal from spectrum 


signal _power=power(udsb( 1:length(1)))/2: 
% % Compute signal power 


noise .power=signal power /snr lin; % Compute noise power 





noise_std=sqrt(noise power): G Compute noise standard deviation 
noise=noise_stderandn( 1 length(u)); % Generate noise vector 
r=utnoise; % Add the signal io noise 
[R.r.dtl]=fitseq(r.ts.df); % Fourier transform 

R=R/fs; % scaling 

pause % Press a key to show the modulated signal power 

signal_power 

pause % Press any key to see a plot of the message signal 

clf 

subplot(2,1,1) 


plot(t,m(1 :length(t))) 

axis((0.0.15,-2.1,2.1]) 

xlabel(‘ Time’) 

title(‘The message signal’) 

pause % Press any key to see a plot of the carrier 
subplot(2, 1,2) 

plot(t.c(1:length()) 

xlabel(‘ Time’) 

tite( The carrier’) 

pause % Press any key to see a plot of the modulated signal and its spectrum 
cif 

subplot(2,1.1) 

plot((0:ts:tse(length(u)— 1)/8),u(1:length(u)/8)} 

xlabel(* Time’) 

title(” The LSSB-AM modulated signal’) 

subplot(2,1,2) 

plot(f,abs(fftshift(ULSSB))) 

xlabel(‘ Frequency’) 

tide(* Spectrum of the LSSB-AM modulated signal‘) 
pause o Press any key 10 see the spectra of the message und the modulated signals 
clf 
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subplot(2,1,1) 

plot(f,abs¢ fftshift(M))) 

xlabel(' Frequency‘) 

tide(’ Spectrum of the message signal‘) 

subplot(2, 1,2) 

pior fabs(fitshift({ ULSSB))) 

xlabel(’ Frequency’) 

title(‘ Spectrum of the LSSB-AM modulated signal’) 
pause % Press any key to see a noise sample 

subplot(2,1.1) 

plot(tnoise(1:length(t))) 

tile(‘noise sample’) 

xlabel( ‘Time ‘} 

pause % Press a key to see the modulated signal and noise 
subplot(2,1,2) 

plot r(t length(t})) 

title(‘Modulated signal and noise‘) 

xlabel(' Time‘) 

subplot(2.1.1) 

pause % Press uny key to see the spectrum of the modulated signat 
plot(f.abs(ffishift(ULSSB})) 

title(’Modulated signal spectrum’) 

xlabel(‘ Frequency‘) 

sudplot(2,1,2) 

pause % Press a key to see the modulated signal noise in freq. domain 
plor(f.abs(fftshift(R))) 

tile(‘Modulated signal noise spectrum’) 

xlabel(‘ Frequency’) 





The m-files ussb.mod.m and Issb_mod.m given below modulate the message signal 
given in vector m using USSB and LSSB modulation schemes. 


ail» — 


function u=ussb.mod(m,ts,fe) 








% u = ussbmodim.ts,fc} 

%USSB_MOD takes signal m sampled at ts and carrier 

% freq. fe as input und returns the USSB modulated 
% signal, ts << 1/2fe. 


t=[O:length(m)—1)«ts; 
usm.xcos(2apist)—imag(hilbert(m)).ssin(2«pi+t); 


hil — 


function u=lssb_mod(m,ts,fc) 











% u = issbmod(m.is fe) 

%LSSB_MOD takes signal m sampled at ts and carrier 

% freq. fe ax input and returns the LSSB modulated 
% signal. ts << 1/2fc. 


t=(O:length(m)—1)ats; 
u=m.*cos(2«piat)+imag(hilbert(m)).«sin(2+pi+t); 
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3.3 Demodulation of AM Signals 


Demodulation is the process of extracting the message signal from the modulated signal. 
The demodulation process depends on the type of modulation employed. For DSB-AM and 
SSB-AM the demodulation method is coherent demodulation, which requires the existence 
of a signal with the same frequency and phase of the carrier at the receiver. For conventional 
AM, envelope detectors are used for demodulation. In this case precise knowledge of the 
frequency and the phase of the carrier at the receiver is not crucial, so the demodulation 
process is much easier. Coherent demodulation for DSB-AM and SSB-AM consists of 
multiplying (mixing) the modulated signal by a sinusoidal with the same frequency and 
phase of the carrier and then passing the product through a lowpass filter. The oscillator 
that generates the required sinusoidal at the receiver is called the local oscillator. 


3.3.1 DSB-AM Demodulation 


In the DSB case the modulated signal is given by A,m(r) cos(27 fet), which when multi- 
plied by cos(2x f-t) (or mixed with cos(2z f,.1)) results in 


Ag Ac 
¥(t) = Apm(t) cos(2 fet) cos(27 fet) = ze) + = m(t) cos(x fet) (3.3.1) 
2 
where y(t) denotes the mixer output, and its Fourier transform is given by 
Ac Ay Ae 
N= SMU) + FMU -2f) + TMF + 2h) (3.3.2) 


As it is seen, the mixer output has a lowpass component of AM(f) and high-frequency 
components in the neighborhood of +2 f,. By passing y(s) through a lowpass filter with 
bandwidth W, the high-frequency components will be filtered out and the lowpass com- 
ponent, 4¢m(z), which is proportional to the message signal, will be demodulated. This 
process is shown in Figure 3.9. 


cos(2m fot) 
1) 





u(t) 








Lowpass Filter Smit) 








Figure 3.9: Demodulation of DSB-AM signals. 


ILLUSTRA E PROBLEM 


Illustrative Problem 3.5 {DSB-AM demodulation} The message signal m(t) is defined 
as 


I Osr<¥ 
2 @sr<% 


0, otherwise 





mt) = 





102 CHAPTER 3. ANALOG MODULATION 


This message DSB-AM modulates the carrier c(t) = cos 27 ft, and the resulting modulated 
signal is denoted by u(t). It is assumed that tọ = 0.15 s and f, = 250 Hz. 


1. Obtain the expression for u(r). 
2. Derive the spectra of m(t) and u(r). 


3. Demodulate the modulated signal u(r) and recover m(t). Plot the results in the time 
and frequency domains. 


$i $$___________ 


1.2. The first two parts of this problem are the same as the first two parts of the IHustrative 
Problem 3.1, and we repeat only those results here; namely, 


“= [n (GS) -20 ( = 7s) cos(50071) 


0.05 0.05 
and 
2 t 
Fim) = Rezino sinc (+) ell sine (2) 
k 

= Penita sine (¥) (i = aniwa) 

= 0.05e7095}7f sinc(0.05 f) ( 2i 2270015) 
Therefore, 


ULF) = 0,025e70 ITU -250 sine (0.05( f — 250) (1 = 2670- lial s) 
+ 0.025670574250 sinc(0.05(F + 250) (1 — 2670171 +250) 
3. To demodulate, we multiply u(r) by cos(27 f-t) to obtain the mixer output y(r) 


y(t) = u(t) cos(2z fet) 


t ~ 0.025 t — 0.075 2 
= [n (5) -20 (2)] cos* (5007r) 


sae a an a) 
+ ; [n (e) -20 (Aw)] cos(1000z7 1) 
whose Fourier transform is given by 
¥(f) = 0.025e7-9S/*/ sinc(0.05 f) (i =e OliaS ) 
+.0.0125¢-005/(/-50 sinc (0.05(F — 500)) (1 — 27% rU =) 
+ 0.0125¢~0-957(1+500 sinc (0.05( f + 500) (: SiM) 
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where the first term corresponds to the message signal and the last two terms corre- 
spond to the high-frequency terms at twice the carrier frequency. We see that filtering 
the first term yields the original message signal (up to a proportionality constant). A 
plot of the magnitudes of U ( f) and ¥(f) is shown in Figure 3.10. 


The demodulator output 

















Figure 3.10: Spectra of the modulated signal and the mixer output in Illustrative Problem 
35. 


As shown above, the spectrum of the mixer output has a lowpass component that is 
quite similar to the spectrum of the message signal, except for a factor of a and a bandpass 
component located at +2 fs (in this case, 500 Hz). Using a lowpass filter we can simply 
separate the lowpass component from the bandpass component. In order to recover the 
Message signal m(t}, we pass y(r) through a lowpass filter with a bandwidth of 150 Hz. 
The choice of the bandwidth of the filter is more or less arbitrary here because the message 
signal is not strictly bandlimited. For a strictly bandlimited message signal, the appropriate 
choice for the bandwidth of the lowpass filter would be W, the bandwidth of the message 
signal. Therefore, the ideal lowpass filter employed here has a characteristic 


1, Ifi < 150 


H = 
A 0, otherwise 
A comparison of the spectra of m(t) and the demodulator output is shown in Figure 3.11, 
and a comparison in the time domain is shown in Figure 3.12. 
The MATLAB script for this problem follows. 


SSS 
% dsbdemm 

% Matlab demonstration script for DSB-AM demodulation. The message signal 

% is +1 for 0 < t < 0/3, -2 for 0/3 < t < 210/3 and zero otherwise. 

echo on 

t0=.15; % signal duration 
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Figure 3.11: Spectra of the message and the demodulated signals in Illustrative Problem 
3.5. 


‘The demexfulater output 
































CL E 
Tae Tem 


Figure 3.12: Message and demodulator output in Illustrative Problem 3.5. 
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ts=1/1500; % sumpling intervat 

fc=250; % carrier frequency 

Is=t/ts: % sampling frequency 
t=[0:ts:10); % time vector 

df=0.3: % desired frequency resolution 


% message signal 
me=[ones( 1.10/(3sts)),-2xonest 1.10/(3ets)), zeros( 1,10 /(3ats)}+1)}; 
c=cos(2epixic.*t); % carrier signal 


usm.sc: % modulated signal 
you.sc; % mixing 
[M.m.dfl}=fftseq(m.s.df); % Fourier transform 
M=M/fs; % scaling 

[U.u.dfl ]=ffiseq(u.ts.d0); % Fourier transform 
UsU/fs: % scaling 
(Y,y.dfl]=ffiseq( y.ts.40; % Fourier transform 
Y=Y/fs: % scaling 

f-cutoff=150: % cutoff freq. of the filter 
n_cutoff=floor( 150/41); % Design the filter 


f=(0:dfl:dfl #(length(y)—1)1-fs/2; 

Hezeros(size(f)): 

H( :n_cutoff }=2*ones(1.n.cutoff), 
Hilength(f)—n_cutoff +1 :length(f))=2+¥ones(1.n cutoff): 


DEM=H.+Y; % spectrum of the filter oupur 
demareal(iffuDEM))efs: % filter output 

pause % Press a key 1 see the effect of mixing 

elf 

subplor(3.1.1) 

plot(f.ffishifi(abs(M))) 


tide( Spectrum of the the Message Signal‘) 
xlabel(* Frequency’) 

subplot(3,1,2) 

plor(f.fftshift(abs(U})) 

title(‘ Spectrum of the Modulated Signal’) 
xlabel(‘ Frequency’) 

subplot(3,1.3) 

plot(£.ftshift(abs(¥))) 

title(* Spectrum of the Mixer Output’) 
xlabel{" Frequency’) 

pause % Press a key to see the effect of filtering on the mixer output 
clf 

subplot{3.1,1} 

plot(f,ffishift(abs(Y))) 

tide(" Spectrum of the Mixer Output’) 
xlabel(' Frequency’) 

subplor(3,1.2) 

plot(f,fftshift(abs(H))) 

title(‘ Lowpass Filter Characteristics’) 
xlabel(* Frequency’) 

subplot(3.1.3) 

plot(f.ffishift(abs(DEM))) 

title(’ Spectrum of the Demodulator output ') 
xlabel(’ Frequency‘) 

pause % Press a key to compare the spectra of the message an the received signal 
clf 

subplot(2.1,1) 

plot(f.fftshift(abs(M))) 
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tile(‘Spectrum of the Message Signal‘) 
xlabel(‘ Frequency’) 

subptot(2,1,2} 

plot f.fftshift(aos(DEM)})) 

tide( “Spectrum of the Demodulator Output’) 
xlabel(‘ Frequency’) 

pause % Press a key t see the message and the demodulator output signals 
subplot(2,1,1) 

pilotiem? Jengeh(t))) 

lide(’The Message Signal‘) 

xlabel{’ Time’) 

subplot(2,1,2) 

plot(t.dem(t:lengthit))) 

utle(’ The Demodulator Output‘) 
xlabel(‘Time') 


fee (LLUSTRATIVE PROBLEM — 


Hlustrative Problem 3.6 [Effect of phase error on DSB-AM demodulation} In the de- 
modulation of DSB-AM signals we assumed that the phase of the local oscillator is equal to 
the phase of the carrier. If that is not the case,—i.e., if there exists a phase shift ġ between 
the local oscillator and the carrier-—how would the demodulation process change? 


-<D 


In this case we have u(t) = A,m(t) cos(27 fet), and the local oscillator generates a sinu- 
soidal signal given by cos(27 fet + $). Mixing these two signals gives 








y(t) = Acm(t) cos(2x fet) x cos(2x fet + 6) (3.3.3) 
femi) cos{ġ) + Semin) cos(4x fet + $) (3.3.4) 


As before, there are two terms present in the mixer output. The bandpass term can be 
filtered out by a lowpass filter. The lowpass term, Zemu) cos(¢}. depends on $, however. 
The power in the lowpass term is given by 
a2 
Piem = g cos 2% (3.3.5) 


where Pm denotes the power in the message signal. We can see, therefore, that in this case 
we can recover the message signal with essentially no distortion, but we will suffer a power 
loss of cos*. For @ = 7/4 this power loss is 3 dB, and for @ = 1/2 nothing is recovered 
in the demodulation process. 


3.3.2 SSB-AM Demodulation 


The demodulation process of SSB-AM signals is basically the same as the demodulation 
process for DSB-AM signals, i.e., mixing followed by lowpass filtering. In this case 


Ae a A 
u(t) = Smit) cos(2m fet) + T ÊO siar fet) (3.3.6) 
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where the minus sign corresponds to the USSB and the plus sign corresponds to the LSSB. 
Mixing u(t) with the local oscillator output. we obtain 


Ac 
yw) = Sm) cos? (2a fet) Em Site sin(2z fet) cos(27 fet) 


Ac Ac Bee os 
= yo + ms) costar fet) F g” sin(4r fet) (3.3.7) 


which contains bandpass components at +2 f; and a lowpass component proportional to 
the message signal. The lowpass component can be filtered out using a lowpass filter to 
recover the message signal. This process for the USSB-AM case is depicted in Figure 3.13. 
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Figure 3.13: Demodulation of USSB-AM signals. 


ILLUSTRATIVE PROBLEM 





Illustrative Problem 3.7 [LSSB-AM example] In a USSB-AM modulation system, if the 
message signal is 


1, O<r<¥% 
m(t) = 4-2, Perc% 


0, otherwise 


with £ = 0.15 s, and the carrier has a frequency of 250 Hz, find U(f) and ¥(f) and 
compare the demodulated signal with the message signal. 


—Eeninp- 


The modulated signal and its spectrum are given in Illustrative Problem 3.4. The expression 
for U(f) is given by 


0.025e~995/*(4~25sinc(0.05( f — 250)) (1 — 2e~° Lia(f-250)) 
= 0.05 jx( f +250) «: -0.Ljn( f+250) fl s fe 
U(f) = $+ 0.025e sinc(0.05(f + 250)) (1 — 267%- U7 J 


0, otherwise 
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and 


i 1 
Y= US - fot UF + fo 


0.0125¢~ 5" sinc(0.05 f) (1 — 2e-P U7) | Us fe 
0.0125¢7005/7(1-500) gine (0.05( f — 500)) (1 — 2e~P 7-50) ft, < f < 2f, 
0.0125¢-0.9517F +500 sinc(0.05( f + 500)) (1 — 2e 97450) -2 fe < f < fe 
0, otherwise 


A plot of Y (f) is shown in Figure 3.14. The signal y(t) is filtered by a lowpass filter with 
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Figure 3.14: Magnitude spectrum of the mixer output in Illustrative Problem 3.7. 


a cutoff frequency of 150 Hz; the spectrum of the output is shown in Figure 3.15. In the 
Figure 3.16 the original message signal is compared with the demodulated signal. 
The MATLAB script for this problem follows. 


a 
% Issbdem.m 

% Matlab demonstration script for LSSB-AM demodulation. The message signal 

% is +l for O < i < 10/3, -2 for 10/3 < t < 210/3 and zero otherwise. 

echo on 
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Figure 3.15: The demodulator output in Illustrative Problem 3.7. 








Figure 3.16: The message signal and the demodulator output in Illustrative Problem 3.7. 
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2 


% signal duration 
sampling interval 
currier frequency 
sampling frequency 
desired freq.resolution 
time vector 





FRR aa 


% the message vectwr 
me=[ones( 1 t0/(34ts)),—2aones(1,t0/(3ets)),zeros( 1 tO/(Sxts)+1)}: 
cacos(2epirfc.«t); % carrier vector 





udsb=m.rc; % DSB modulated signat 
(UDSB.udsb,df? |=ffiseq(udsb.ts.df): % Fourier transform 
UDSB=UDSB/ts: % scaling 

n2zceil(fe/dtt); % lucation of carrier in freq. vector 


% remove the upper sideband from DSB 

UDSB(n2:tength( UDSB)~n2)=zeros(size( UDSB(n2:length(UDSB)—n2))}: 
ULSSB=UDSB; % Generate LSSB-AM spectrum 
(M.mdfl J=ffiseg(m.s.df ): % spectrum of the message signal 
M=M/fs: % scaling 

f=(O-df l:dfls(length(M)—1)}~f5/2; % frequency vector 
usreallifft(ULSSA))«fs: % generate LSSB signal from spectrum 
% mixing 

y=u acos( 2e pisfes[O:ts:tsx(lengthtu)— 1))); 

[Y ydf lJ=fftseq(y.ts.df); % spectrum of the output of the mixer 
YeY/ts: % scaling 

fcutoff=150; % Choose the cutoff freq. of the filter 
n-cutoff=fioor(150/4f): % design the filter 

Hazeros(size(f)): 

H(1:n_cutoff)=4eones( 1 a_cutoff); 

% spectrum of the filter output 

Hilength(f)—n_cutoff +1 :length(f))=4sones(1.0_cutoff): 


DEM=H.+Y; % spectrum of the filter output 
dem=real(ifft(DEM))«fs; % filter output 

pause % Press a key to see the effect of mixing 

lf 


subplor(3,1,1) 

plot(f.fftshift(abs(M))) 

tile(’ Spectrum of the the Message Signal’) 
xlabel{ Frequency") 

subptot(3,1,2) 

plot(f.fftshift(abs(ULSSB))) 

title(’ Spectrum of the Modulated Signal’) 
xlabel(‘ Frequency’) 

subplot(3, 1,3) 

plot(f,tftshift(abs(Y))) 

tile’ Spectrum of the Mixer Output’) 
xlabel{ Frequency’) 

pause % Press u key to see the effect of filtering an the mixer output 
olf 

subplot(3.4,1) 

plot(ftftshift(abs(Y))) 

title(' Spectrum of the Mixer Output’) 
xfabel(' Frequency’) 

subpiot(3,1.2) 

ploc(f,fftshift(abs(H))) 

title(*Lowpass Filter Characteristics’) 
xlabel{' Frequency ') 
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subplot(3.1,3) 

plot(f.fftshift({abs(DEM)}) 

litle(" Spectrum of the Demodulator output’) 
xlabel(‘ Frequency’) 

Pause % Press a key iv see the message and the demodulator output signals 
subplot(2,1,1) 

plotit.m(1:length(t))) 

litle("The Message Signal’) 

xlabel{ Time”) 

subplot(2,1,2) 

plot(t.dem(1 -fength(t))) 

tile(*The Demodulator Output‘) 

xlabel(« Time’) 


SS 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 3.8 [Effect of phase error on SSB-AM] What is the effect of phase 
error in the SSB-AM? 


_Enliip— 


Assuming that the local oscillator generates a sinusoidal with a phase offset of $ with respect 
to the carrier, we have 





y(t) = u(t) cos(2a fet +o) 


= [Emo cos(2r fet) F fa sin(anfi)| cos(2r fet + $) 
= “m(t) cos + Sealsin ¢ + high-frequency terms (3.3.8) 


As seen, unlike the DSB-AM case, the effect of the phase offset here is not simply 
attenuating the demodulated signal. Here the demodulated signal is attenuated by a factor 
of cosġ as well as distorted by addition of the +4 ac) sing term. In the special case 


of $ = 7/2, the Hilbert transform of the signal will be demodulated instead of the signal 
itself. 


3.3.3 Conventional AM Demodulation 


We have already seen that conventional AM is inferior to DSB-AM and SSB-AM when 
power and SNR are considered. The reason is that a usually large part of the modulated 
signal power is in the carrier component that does not carry information. The role of the 
carrier component is to make the demodulation of the conventional AM easier via enve- 
lope detection, as opposed to coherent demodulation required for DSB-AM and SSB-AM. 
Therefore, demodulation of AM signals is significantly less complex than the demodulation 
of DSB-AM and SSB-AM signals.Hence, this modulation scheme is widely used in broad- 
casting, where there exists a single transmitter and numerous receivers whose cost should 
be kept low. In envelope detection the envelope of the modulated signal is detected via a 
simple circuit consisting of a diode, a resistor, and a capacitor, as shown in Figure 3.17. 
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Figure 3.17: A simple envelope detector. 


Mathematically, the envelope detector generates the envelope of the conventional AM 
signal, which is 


Vit) = |l + am (D| (3.3.9) 
Because 1 + mp(t) > 0, we conclude that 
Vi) = 1l+tam,(t) (3.3.10) 


where m,(t) is proportional to the message signal m(r) and 1 corresponds to the carrier 
component that can be separated by a de-block circuit. As seen, in the above procedure 
there is no need for knowledge of $, the phase of the carrier signal. That is why such a 
demodulation scheme is called noncoherent, or asynchronous, demodulation. Recall from 
Chapter that the envelope of a bandpass signal can be expressed as the magnitude of its 
lowpass equivalent signal. Thus if u(t) is the bandpass signal with central frequency fe 
and the lowpass equivalent to s(t) is denoted by u(t), thea the envelope of u(t), denoted 


by V(t), can be expressed as 
Ve) = fu) + aR 
= uzt) +u) (3.3.11) 


where u,(t) and u y(t) represent the in-phase and the quadrature components of the bandpass 
signal u(t), Therefore, in order to obtain the envelope, it is enough to obtain the lowpass 
equivalent of the bandpass signal. The envelope is simply the magnitude of the lowpass 
equivalent of the bandpass signal. 








Ilustrative Problem 3.9 [Envelope detection] The message signal 


1 O<t<% 


m= 4-2, ¥sr< 4 
0, otherwise 


modulates the carrier c(t) = cos(2x fet) using a conventional AM modulation scheme. It 
is assumed that f; = 250 Hz and tọ = 0.15 s, and the modulation index is a = 0.85. 
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1. Using envelope detection, demodulate the message signal. 


2. If the message signal is periodic with a period equal to fọ and if an AWGN pro- 
cess is added to the modulated signal such that the power in the noise process is 
one-hundredth the power in the modulated signal, use an envelope demodulator to 
demodulate the received signal. Compare this case with the case where there is no 
noise present. 


END 





1. As in Illustrative Problem 3.3, we have 


a(t) = i +0. ss] cos(27 fet) 


= PA 
= [i +o.nsn( OS 


t - 0.075 
= 0.8511(————) | cos 
05 7 ( 005 | cos(500x:) 


If an envelope detector is used to demodulate the signal and the carrier component 
is removed by a de-block, then the original message m(t) is recovered, Note that a 
crucial point in the recovery of m(r) is that for all values of t, the expression 1 +amp (t) 
is positive; therefore, the envelope of the signal [1 + amn (t)}] cos(27 fet), which is 
V(t) = |1 + am,(1)|, is equal to 1 + am,(t), from which m(r) can be recovered 
easily. A plot of the conventional AM modulated signal and its envelope as detected 
by the envelope detector are shown in Figure 3.18. 

















Figure 3.18: Conventional AM modulated signal and its envelope. 


After the envelope detector separates the envelope of the modulated signal, the de 
component of the signal is removed and the signal is scaled to generate the demod- 
ulator output. Plots of the original message signal and the demodulator output are 
shown in Figure 3.19. 
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Figure 3.19: The message signal and the demodulated signal when no noise is present. 


2. When noise is present, some distortion due to the presence of noise will also be 
present. In Figure 3.20 the received signal and its envelope are shown. In Figure 
3.21 the message signal and the demodulated signal are compared for this case. 


iw 
| Leet 


Figure 3.20: The received signal and its envelope in the presence of noise. 























The MATLAB script for this problem follows. 


oe ED eS Se ey 
% amdemm 

% Matlab demonstration script for envelope detection. The message signal 

% is +1 for O < t < 10/3, -2 for 10/3 < t < 210/3 und zero otherwise. 


echo on 

t0=15; % signal duration 
ts=0.001; % sampling interval 
fo=250; % carrier frequency 
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Figure 3.21: The message and the demodulated signal in the presence of noise. 





% modulation index 





As: % sumpling frequency 
t=[0:1s:t0]; % time vector 
df=0.25; % required frequency resolution 


% message signal 








m=(ones(1,10/(3e1s)},-Zeones( 110 /(3sts)),zeros(1,t0/(3ets)+1)); 
c=cos(2+pisfc.«t); % carrier signal 
m_n=m/max(abs(m)); % normalized message signal 
[M.m.df] ]=ffiseq(m.ts.df); % Fourier transform 
F=(O:6f1-dfl «{length(m)—1)]—fs/2; % frequency vector 


u=(1+a*m_n).sc; 
[U.u.dfl]=fftseq(uts,df}: 
env=env_phas(u): 
deml=2e(env—1)/a: 

signal. power=power(u(1-length(t)}); 
noise. power=signal_power/100; 
Noise_std=sqrt{noise_power); 
noise=noise .stderandn( 1 Jength(u)); 
T=uU+noise; 


modulated signal 

Fourier transform 

Find the envelope 

Remove dc and rescale 

power in modulated signal 
noise power 

noise standard deviation 
generate noise 

Add noise to the modulated signal 
[R.r.dfl }=fftseq(r,ts,df); Fourier transform 
env.r=env_phas(r): envelope, when noise is present 
dem2=2¢(env_r—1)/a; % Demodulate in the presence of noise 
pause % Press any key to see a plot of the message 

subplot(2.1,1) 

plot(t,m(1:tength(t))) 

axis({0 0.15 -2.1 2.1}) 

xlabel(‘ Time’) 

lide(‘The message signal’) 

pause % Press uny key to see a plot of the moduluted signal 

subplot(2,1,2) 

plot(t,u(1:length(t))) 

axis((0 0.15 -2.14 2.1]) 

xlabel(’ Time’) 

title(’ The modulated signal’) 

pause % Press a key to see the envelope of the modulated signal 

clf 


KKK KA ARK ARS 
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subplot(2,1,1) 

plot(su(1lengeh(t)) 

axis([0 0.15 -2.1 2.1) 

xlabel( Time’) 

title The modulated signal’) 

subplot(2,1,2) 

plot(tenv(t:length())) 

xlabei( Time’) 

titlet’ Envelope of the modulated signal’) 
pause % Press u key to compare the message and the demodulated signal 
olf 

subplo(2,1,1) 

plot(tan(tlength(o)) 

anis((O 0.18 -2.1 2.1]) 

xlabel( ‘Time *) 

title(’ The message signal’) 

subplor(2,1,2) 

plou(tdem1(1length(0)) 

xlabel( Time’) 

lile(’ The demodulated signal’) 

pause % Press a key to compare in the presence of noise 
elf 

subptor(2,1.1) 

plot(tm(1:length(t)}) 

axis([0 0.15 -2.1 2.1) 

xlabel( Time’) 

titlet’ The message signal’) 

subplot(2.1.2) 

plot(t,dem2(1:length(t})) 

xlabel(‘ Time’) 

titlet’ The demodulated signal in the presence of noise’) 


me COMMENT — 


In the demodulation process above, we have neglected the effect of the noise-limiting filter, 
which is a bandpass filter in the first stage of any receiver. In practice the received signal 
r(t) is passed through the noise-limiting filter and then supplied to the envelope detector. 
In the above example, since the message bandwidth is not finite, passing r (t) through any 
bandpass filter will cause distortion on the demodulated message, but it will also decrease the 
amount of noise in the demodulator output. In Figure 3.22 we have plotted the demodulator 
outputs when noise-limiting filters of different bandwidths are used The case of infinite 
bandwidth is equivalent to the result shown in Figure 3.21. 








3.4 Angle Modulation 


Angie-modulation schemes, which include frequency modulation (FM) and phase modula- 
tion (PM), belong to the class of nonlinear modulation schemes. This family of modulation 
schemes is characterized by their high-bandwidth requirements and good performance in 
the presence of noise, These schemes can be visualized as modulation techniques that 
trade-off bandwidth for power and, therefore, are used in situations where bandwidth is not 
the major concern and a high SNR is required. Frequency modulation is widely used in 
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Infinite Banowidth 














Figure 3.22: Effect of the bandwidth of the noise-limiting filter on the output of the envelope 
detector. 
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high-fidelity FM broadcasting. TV audio broadcasting, microwave carrier modulation, and 
point-to-point communication systems. 

In our treatment of angle-modulation schemes, we again concentrate on their five basic 
properties, namely, time-domain representation, frequency-domain representation, band- 
width, power content, and, finally, SNR. Since there is a close relationship between PM and 
FM, we will treat them in parallel, with emphasis on FM. 

The time-domain representation of angle-modulated signals, when the carrier is c(t) = 
A, cos(2x fet) and the message signal is m(r), is given by 


Av cos (27 fut + Kpm(t)) , PM 


2 3.4.1 
A cos (22 fa + 2k fl,,m(r)dr), FM sae 


u(t) = | 


where ky and kp represent the deviation constants of FM and PM, respectively. The 
frequency-domain representation of angle-modulated signals is, in general, very complex 
due to the nonlinearity of these modulation schemes. We treat only the case where the 
message signal m(t) is a sinusoidal signal. We assume m(t) = a cos(27t fmt) for PM and 
m(t) = ~asin(27 fmt) for FM. Then, the modulated signal is of the form 


u(t) = A. cos(2m fet + Bp cos(2m fmt)), PM (3.42) 
Ac cos(2m fet + By cos(27 fmt)), FM 
where 
Bp = kpa 
kja (3.4.3) 
by = 
Sn 


and Bp and £p are the modulation indices of PM and FM, respectively. In general, for a 
nonsinusoidal m(t}, the modulation indices are defined as 


Bp = kp max |m(t)| 
 _ kp max |m(s)| 34.4) 
Bramy 


where W is the bandwidth of the message signal m(t). In case of a sinusoidal message 
signal the modulated signat can be represented by 


u(t) = > Acdn(B) cosa fu + nfm)! (3.4.5) 


n=~00 


where Ja (8) is the Bessel function of the first kind and of order n and Bis either Bp or By, 
depending on whether we are dealing with PM or FM. In the frequency domain we have 





bed ; cd, 
ups D [Eag rna Eara] 046 


n=- 
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Obviously, the bandwidth of the modulated signal is not finite. However, we can define the 
effective bandwidth of the signal as the bandwidth containing 98% to 99% of the modulated 
signal power. This bandwidth is given by Carson's rule as 


Br = 2B + 1)W 3.4.7) 


where is the modulation index, W is the bandwidth of the message, and Br is the 
bandwidth of the modulated signal. 

The expression for the power content of the angle-modulated signals is very simple. 
Since the modulated signal is sinusoidal, with varying instantaneous frequency and constant 
amplitude, its power is constant and does not depend on the message signal. The power 
content for both FM and PM is given by 


A 
P, = 7 (3.4.8) 


The SNR for angle modulated signals, when no pre-emphasis and de-emphasis filtering 
is employed. is given by 


Pubi P; 
m sa 
(5) =} m maw: PM (3.49) 
o 


N Pubi P, 

Simax mon? Na: FM 
Since max |m(r)| denotes the maximum magnitude of the message signal, we can interpret 
Pu /(max |m{t){)? as the power in the normalized message signal and denote it by Pu, 
When pre-emphasis and de-emphasis filters with a 3-dB cutoff frequency equal to fọ are 
employed, the SNR for FM is given by 





(7) Ee 
= (3.4.10) 
Ni opp 3(W/fo ~ arctan(W/fo)) \N J, 


where (S/N)o is the SNR without pre-emphasis and de-emphasis filtering given by Equation 
3.4.9. 


ILLUSTRATIVE BLEM 


Illustrative Problem 3.10 [Frequency modulation] The message signal 


l, O<t< $ 
m(t) = {-2, Yer < Be 
0, otherwise 


modulates the carrier c(t) = cos(2mf;t) using a frequency-modulation scheme. It is 
assumed that fe = 200 Hz and tọ = 0.15 s; the deviation constant is kp = 50, 


1. Plot the modulated signal. 


2. Determine the spectra of the message and the modulated signals. 
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‘ 
u(t) = Ap cos (2m fet ant, J maar) 
-% 


We have to find is m(t)dt. This can be done numerically or analytically, and the 
results are shown in Figure 3.23. 
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Figure 3.23: The integral of the message signal. 


Using the relation for u(t) and the value of the integral of m(t), as shown above, we 
obtain the expression for u(t). A plot of m(t) and u(r) is shown in Figure 3.24. 


2. Using MATLAB’s Fourier transform routines, we obtain the expression for the spec- 
trum of u(t) shown in Figure 3.25. It is readily seen that unlike AM, in the FM 
case there does not exist a clear similarity between the spectrum of the message and 
the spectrum of the modulated signal. In this particular example the bandwidth of 
the message signal is not finite, and therefore to define the index of modulation, an 
approximate bandwidth for the message should be used in the expression 


ky max \m(t)} 


B= G41) 


We can, for example, define the bandwidth as the width of the main lobe of the 
spectrum of m(t), which results in 


W = 20Hz 
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Figure 3.24: The message signal and the modulated signal. 








Figure 3.25: The magnitude-spectra of the message and the modulated signal. 
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The MATLAB script for this problem follows. 











mlam 


% Matlab demonstration script for frequency modulation. The messuge signul 


“Cas +d fur O < t < 10/3, -2 for 0/3 < t < 210/3. und zero otherwise. 


ashu on 


tis 18; 





T message signal 
maj 





ni FO; 
for i=1 tength(t)—1 

int m= 1 )=ant_m(i)+ enti pets: 
end 
iM maf j=fftseq(mus.df), 
MMs; 











S(2«pi=fcet+2xpi*kfsint m}; 





pause % Press uny key to see a plot of the message und the modulated signal 


subplot(2,1.1) 

plotit.m(1 length(t))) 

ausi[0 0.15 ~2.1 2.1) 
dabei’ Time’) 

ule’ The message signal’) 
subplot2.1,2) 

plotui 4:length(t))) 

axis((O 0.15 -2.1 2.1]) 
Xlabel( Time’) 


titel’ The modulated signal’) 
pause % Press any key to see a plots of the magnitude of the message and the 


% 
subplot(2.1.1) 

plot f.abs( fftshift(M))) 
Mabel‘ Frequency’) 


(O:d fl -dfl «(length(m}—1}]-fs/2: 


% signul duration 
% sampling interval 

% carrier frequency 

% modulauon index 

sampling frequency 

ume vector 

required frequency resolution 


RAR 


ones! 1.10/'(Sets)), -2eones(1 t0/(3ets)),2eros(1 t0/(3ets}+ 1}, 


% integral of m 


% Fourier transform 
% scaling 
% frequency vector 
% modulated signal 
% Fourier transform 
% scaling 


% modulated signal in the frequency domain. 


title ‘Magnitude-spectrum of the message signal’) 


subplot(2,1,2) 
pion tabs( fitshift(U))) 


title ‘Magnitude-spectrum of the modulated signal’) 


Nabel ' Frequency’) 





LLUSTRATIVE PROBLEM 


Iilustrative Problem 3.11 [Frequency modulation] Let the message signal be 
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Gis sinc(100r), |r| < to 


a otherwise 


1. Plot the modulated signal in the time and frequency domain. 


2. Compare the demodulator output and the original message signal. 


im SOLUTION 


where to = 0.1. This message modulates the carrier c(t) = cos(2r fet}, where fe = 250 
Hz. The deviation constant is ky = 100. 





|. We first integrate the message signal and then use the relation 


1 


u(t) = Ao cos (2x4: +2nky f m(t)dt 


-æ 


to find u(r). A plot of u(r) together with the message signal is shown in Figure 3.26. 


The integral of the message signal is shown in Figure 3.27. 
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Figure 3.26: The message and the modulated signals. 


A plot of the modulated signal in the frequency domain is shown in Figure 3.28. 


2. To demodulate the FM signal, we first find the phase of the modulated signal u(t). 
This phase is 2z ky f! ., m(t) dt, which can be differentiated and divided by 2k f 
to obtain m(¢). Note that in order to restore the phase and undo the effect of 27r phase 
foldings, we employ the unwrap.m function of MATLAB, Plots of the message signal 
and the demodulated signal are shown in Figure 3.29. As you can see, the demodulated 


signal is quite similar to the message signal. 
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Figure 3.27: Integral of the message signal. 
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Figure 3.28: Magnitude-spectra of the message and the modulated signal. 
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Figure 3.29: The message signal and the demodulated signal. 


The MATLAB script for this problem follows. 


en 


% fm2.m 
% Matlab demonstration script for frequency modulation. The message signal 
% is mft}=senct 1001) 

echo on 








10=.2; 


% signal duration 
% sampling interval 

% carrier frequency 

% SNR in dB (logarithmic) 

% sampling frequency 

% required freq. resolution 

% time vector 

% deviation constant 

% required frequency resolution 











m=sinc(100«t), % the message signal 

int_m(1)=0; 

for i=t:length(t)—1 % integral of m 

ant_m(i+ 1)=1nt_m(i}+m(i)«ts; 

end 

[M.m.dfJ=fftseq(mats.df): % Fourier transform 

M=M/1 % scaling 

f={0:df1:df] «(length(m)—1)}—fs/2: % frequency vector 

u=cos(2*pisfest+2epixkfeint.m): % modulated signal 

[U.u.dfl }=fftseq(u.ts,df): % Fourier transform 
jis: % scaling 

[v.phase]=env_phas(u.ts.250); % demodulation, find phase of u 

phi=unwrapt phase): % restore original phase 


dem=(1/(2epixk{))«(diff(phi)/ts); % demodulator output, differentiate and scule phase 
pause % Press any key w see a plot uf the message and the modulated signal 

subplot(2, 1.1) 

plot(t,m(1:length(t)}) 

xlabel(’ Time’) 

title(‘The message signal’) 
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subplot(2,1,2) 

piot(t,u( 4 slength{t})) 

xlabel(' Time‘) 

ltle(’ The modulated signal‘) 

pause % Press any key to yee a plots of the magnitude of the message and the ' 
% modulated signal in the frequency domain. 

subplot(2.1,1) 

plot(fabs{fftshift(M})) 

xlabel{ ‘ Frequency’) i 

ude(‘Magnitude-spectrum of the message signa:’) 

subplot(2,1,2) 

plot(f.abs( fftshift(U))}) l : 

ttle( ‘Magnitude-spec trum of tne modulated signal’) 

xlahbel{ : Frequency’) 

pause % Pres any key to see plots uf the message and the demodulator output with no 
% noise 

subplot(2,1,1} 

plotenm(1 iength(t})) 

xlabel{’ Time’ } 

tule(' The message signal') 

subplot(2,1,2) 

plot(t.dem(1 slength(t}}) 

xlabe!l( Time‘) 

tuel The demodulated signal') 





$$ 


A frequency-modulated signal has constant amplitude. However, in Figure 3.26 us 
amplitude of the signal u {t} is apparently not constant. Can you explain why this happens’? 
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Problems 


3.1 Signal mít) is given by 


t, 0l<ż:<l 
m= {t +2, ber 19 
0.1, otherwise 


in the interval [0, 2]. This signal is used to DSB modulate a carrier of frequency 25 Hz and 


amplitude | to generate the modulated signal u(f). Write a MATLAB m-file and use it to 
do the following. 


a. Plot the modulated signal. 
b. Determine the power content of the modulated signal. 
c. Determine the spectrum of the modulated signal. 


. Determine the power spectral density of the modulated signal and compare it with 
the power spectral density of the message signal. 


3.2 Repeat Problem 3.1 with 


] 
2 


O<t 
mít) = i 


<t 


IA A 


—t+2, 


in the interval (0, 2]. What do you think is the difference between this problem and Prob- 
lem 3.1? 


3.3 Repeat Problem 3.1 with 


sine*(102), lt] <2 


m(t) = 
o 0, otherwise 


and a carrier with frequency of 100 Hz. 


3.4 In Problem 3.1 suppose instead of DSB, a conventional AM scheme is used with a 
modulation index of a = 0.2. 


a. Determine and plot the spectrum of the modulated signal, 


b. Change the modulation index from 0.1 to 0.9 and explain how it affects the spectrum 
derived in part a. 


c. Plot the ratio of the power content of the sidebands to the power content of the carrier 
as a function of the modulation index. 
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3.5 In Problem 3.1 let the modulation scheme be USSB instead of DSB. First use a DSB 
scheme and then remove the lower sideband. 


a. Determine and plot the modulated signal. 
b. Determine and plot the spectrum of the modulated signal. 


c. Compare the spectrum of the modulated signal to the spectrum of the unmodulated 
signal. 


3.6 Repeat Problem 3.5, but instead of using a filtered DSB to generate the USSB signal, 
use the relation 


Ac =~ 
u(t) = fE miosa fit) - zn sin(27 fet) 
Do you observe any differences with the results obtained in Problem 3.6. 
3.7 Repeat Problems 3.5 and 3.6 but substitute the message signal with 


sinc?(10t), Ii <2 


mie 0, otherwise 


and use a cartier frequency of 100 Hz to generate an LSSB signal. 


3.8 Signal 
t, O1l<t<1 
mit) =%{—t+2, 1<e<19 
OI otherwise 


is used to modulate a carrier with frequency of 25 Hz using a DSB scheme. 


a. Determine and plot the modulated signal. 


b. Assume that the local oscillator at the demodulator has a phase lag of @ with the 
carrier, where O < @ < 2/2. Using MATLAB, plot the power in the demodulated 
signal versus 9 (assume noiseless transmission). 


3.9 In Problem 3.8 assume that the modulation scheme is USSB. Plot the demodulated 
signal for @ = 0°, 30°, 45°, 60°, 90°. 


3.10 Repeat Problem 3.8, assuming the modulation is conventional AM with a modulation 
index of 0.2. Use an envelope detector to demodulate the signal in the absence of noise and 
plot the demodulated signal. and its spectrum. 
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3.11 A message signal is periodic with a period of 2 s and in the time interval [0, 2] is 
defined as 


i Ol<r<l 
m(th= 4-742, 1<t<19 
0. otherwise 


This message signal DSB modulates a carrier of 50 Hz. Plot the output of the DSB de- 
modulator and compare it with the message for the cases where a white Gaussian noise is 
added to the modulated signal with a power equal to 0.001, 0.01, 0.05, 0.1, and 0.3 of the 
modulated signal. 


3.12 Repeat Problem 3.11 with a LSSB modulation scheme. Compare your results with 
the results obtained in Problem 3.11. 


3.13 Repeat Problem 3.1! with a conventional AM modulation and envelope demodulation. 
3.14 The signal 


ts siet 
mths {t +2, l<is2 
0.1. otherwise 


frequency-modulates a carrier with frequency 1000 Hz. The deviation constant is ky =25. 
a. Determine the range of the instantaneous frequency of the modulated signal. 
b. Determine the bandwidth of the modulated signal 
c. Plot spectra of the message and the modulated signat. 
d. Determine the modulation index. 


3.15 Demodulate the modulated signal of Problem 3.14 using a frequency demodulation 
MATLAB file and compare the demodulated signal with the message signal. 


3.16 Let the message signal be a periodic signal with period 2 described in the (0, 2] interval 
by 


A O<rt<l 
mt)=¢-14+2, 1<1<19 
0.1 otherwise 


and let the modulation scheme be the one described in Problem 3.14. Before demodulation 
additive white Gaussian noise is added to the modulated signal. Demodulate and plot the 
demodulated signal when the ratio of noise power to the modulated signal power is 0.001, 
0.01, 0.05, 0.1, and 0.3. 


3.17 In Problem 3.16 assume m(t) = 0. Add the noise processes to the modulated signal 
as described and demodulate the resulting signal. Plot the power spectral density of the 
demodulator output in each case. 





Chapter 4 


Analog-to-Digital Conversion 


4.1 Preview 


The majority of information sources are analog by nature. Analog sources include speech, 
image, and many telemetry sources. In this chapter we consider various methods and 
techniques used for converting analog sources to digital sequences in an efficient way. This 
is desirable because, as we will see in subsequent chapters, digital information is easier to 
Process, to communicate, and to store. The general theme of data compression, of which 
analog-to-digital conversion is a special case, can be divided into two main branches: 


l. Quantization (or lossy data compression), in which the analog source is quantized 
into a finite number of levels. In this Process some distortion will inevitably oc- 
cur, so some information will be lost. This lost information cannot be recovered. 
General A/D techniques such as pulse code modulation (PCM), differential pulse 
code modulation (DPCM), delta modulation (4M), uniform quantization, nonuni- 
form quantization, and vector quantization belong to this class. The fundamental 


limit on the performance of this class of data-compression schemes is given by the 
rate-distortion bound. 


2. Noiseless coding (or lossless data compression), in which the digital data (usually 
the result of quantization, as discussed above) are compressed with the goal of rep- 
Tesenting them with as few bits as possible, such that the original data sequence can 
be completely recovered from the compressed sequence. Source-coding techniques 
such as Huffman coding, Lempel-Ziv coding, and arithmetic coding belong to this 
class of data-compression schemes. In this class of coding schemes no loss of infor- 
mation occurs. The fundamental limit on the compression achieved by this class is 
given by the entropy of the source. 
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4.2 Measure of Information 


The output of an information source (data, speech, video, etc.) can be modeled as a random 
process. For a discrete-memoryless and stationary random process, which can be thought 
of as independent drawings of one random variable X, the information content, or entropy. 
is defined as 


A(X) =- Z pix) log p(x) (4.2.1) 
tex 


where X denotes the source alphabet and p(x) is the probability of the letter x. The base of 
the logarithm is usually chosen to be 2, which results in the entropy being expressed in bits. 
For the binary alphabet with probabilities p and ! — p, the entropy is denoted by Hp(p) 
and is given by 


Hp(p) = ~plog p — (i ~ p)log(1 = p) (4.2.2) 


A plot of the binary entropy function is given in Figure 4.1. 

















Figure 4.1: Plot of the binary entropy function. 


The entropy of a source provides an essential bound on the number of bits required to 
represent a source for full recovery. In other words, the average number of bits per source 
output required to encode a source for error-free recovery can be made as close to H(X) as 
we desire, but cannot be less than H(X). 


4.2.1 Noiseless Coding 


Noiseless coding is the general term for all schemes that reduce the number of bits required 
for the representation of a source output for perfect recovery. The noiseless coding theorem, 





OS Re ee a ere os 


due to Shannon, states that for perfect reconstruction of a source it is possible to use a code 
with a rate as close to the entropy of the source as we desire. but it is not possible to use a 
code with a rate less than the source entropy. In other words, for any € > 0, we can have 
a code with rate less than H(X) + €, but we cannot have a code with rate less than H(X), 
regardless of the complexity of the encoder and the decoder. There exist various algorithms 
for noiseless source coding, Huffman coding and Lempel-Ziv coding are two examples. 
Here we discuss the Huffman coding algorithm. 


Huffman Coding 


In Huffman coding we assign longer codewords to the less probable source outputs and 
shorter codewords to the more probable ones. To do this we start by merging the two least 
probable source outputs to generate a new merged output whose probability is the sum of 
the corresponding probabilities. This process is repeated until only one merged output is 
left. In this way we generate a tree. Starting from the root of the tree and assigning O's 
and 1's to any two branches emerging from the same node, we generate the code. It can be 
shown that in this way we generate a code with minimum average length among the class 
of prefix-free codes.' The foltowing example shows how to design a Huffman code. 


ILLUST' IVE PROBLEM 


Illustrative Problem 4.1 [Huffman coding} Design a Huffman code for a source with 
alphabet X = (xy,.x2.....2 xg}, and corresponding probability vector 








p = (0.2, 0.15. 0.13, 0.12. 0.1. 0.09, 0.08, 0.07, 0.06) 


Find the average codeword length of the resulting code and compare it with the entropy of 
the source. 


Sep —$£ $$____________ 


We follow the algorithm outlined above to get the tree shown in Figure 4.2. 
The average codeword length for this code is 


L=2x0.2 +3 x (0.154+0.13+0.12+0.1) +4 x (0.09 + 0.08 + 0.07 + 0.06) 
= 3.1 bits per source output 
The entropy of the source is given as 


9 
A(X)=- ye pi log pj = 3.0371 bits per source output 


We observe that L > H(X), as expected. 


The MATLAB function entropy.m given below calculates the entropy of a probability 
vector p. 


'Prefix-free codes are codes in which no codeword is a prefix of another codeword. 
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Codewords 


00 


x1 


x3 


x4 


xy 


xg 
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Figure 4.2: Huffman code tree. 
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E 


function h=eniropy(p) 

% H = ENTROPY(P) returns the entropy function of 

% the probability vector p. 

if length(find(p<0))"=0. 
emor("Not a prob. vector, negative component (s)’) 

end 

if abs(sum(p)-1)> 10e—10, 
emort Not a prob. vector, 

end 

h=sum(—p.*log2(p)) 














sonents do not add up to 1") 





The quantity 


H(X) 
aN 4.2.3) 
n Z ( 
is called the efficiency of the Huffman code. Obviously, we always have 7 < 1. In gen- 


eral, it can be shown that the average codeword length for any Huffman code satisfies the 
inequalities 


H(X) < Lh < A(X) 41 (4.2.4) 


If we design a Huffman code for blocks of length K instead of for single letters, we will 
have 


H(X) < L < H(X) +z (4.2.5) 


and, therefore, by increasing K we can get as close to H(X) as we desire. Needless to 
say, increasing K increases the complexity considerably, It should also be noted that the 
Huffman coding algorithm does not result in a unique code due to the arbitrary way of 
assigning 0’s and 1's to different tree branches. That is why we talk about a Huffman code 
rather than the Huffman code. 

The MATLAB function huffman.m, which designs a Huffman code for a discrete- 


memoryless source with probability vector p and returns both the codewords and the average 
codeword length, is given below. 








function [h,l}=huffman(p}; 
%HUFFMAN Huffman code generator 


% (Al) = huffmantp), Huffman code generator 
% returns h the Huffman code matrix, and } the 
% average codeword length for a source with 
% probability vector p. 


if length(find(p <0))"=0, 
emor( ‘Not a prob. vector, negative component (s) ) 
end 


if abs(sum(p)—1)> 108-10, 
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eror(‘Not_a prob. vector, components do not add up to 1") 
end 
natength(p); 
gsp: 
mezeros(n—1,n): 
for istn—1 
[q.lJ=sort(q); 
(iv. )= {C4 :n—i+1),zeros(1i- D; 
g=(q¢4)+q(2).q(3:0).1}: 


end 
for i= tin—1 

c(i.: )=blanks(n»n); 
end 
e(n=1,n)=' 0"; 
c(n—1.24n)=' 1") 
for n-1 





c(n=i, 1:n- 1j=cin=i+1 n{findimin—i+ i: ==1)) 
-in~ 2na(find(min-i+1,:)==1))): 
cinin’ 0"; 
ctn—in+1:2#n-1)=c(n-i.t:n-1): 
ctn=i,2en)=' 1*5 
for j=t:i-1 
cln-ij+ Vent j+2)en)=c(n—=i+1,. 
nx(find(m(n—i+ 4 ,:)==j+1)—1)+1nefind(m(n—i+1.)==j+ 1D), 
end 
end 
for i= 4:0 
hE A -n)ec(4 ne(find(n(1 :}esi)—1)+1 find(m(1)==i)en); 
1Li)=tength( find(abs(h(i.:))"=32)); 
end 
l=sum(p.+11); 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 4.2 [Huffman coding] A discrete-memoryless information source 
with alphabet 














X = {x3 X2,- X6} 
and the corresponding probabilities 
p = (0.1, 0.3, 0.05, 0.09, 0.21, 0.25} 
is to be encoded using Huffman coding. 


1. Determine the entropy of the source. 


2. Find a Huffman code for the source and determine the efficiency of the Huffman 
code, 


3. Now design a Huffman code for source sequences of length 2 and compare the 
efficiency of this code with the efficiency of the code derived in part 2. 
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mm SOLUTION 


1. The entropy of the source is derived via the entropy.m function and is found to be 
2.3549 bits per source symbol. 





2. Using the huffman.m function we can design a Huffman code for this source. The 
codewords are found to be 010, 11, 0110, 0111. 00, and 10. The average codeword 
length for this code is found to be 2.38 binary symbols per source output. Therefore, 
the efficiency of this code is 





3. A new source whose outputs are letter pairs of the original source has 36 output 

letters of the form {(x;, x; yé =i; Since the source is memoryless, the probability of 
each pair is the product of the individual letier probabilities. Thus, in order to obtain 
the probability vector for the extended source, we must generate a vector with 36 
components, cach component being the product of two probabilities in the original 
probability vector p. This can be done by employing the MATLAB function kron.m 
in the form of kron(p, p}. The Huffman codewords are given by 


1110000, 01110, 10110111, 1011001, 411001, 00101, 01111, 000, 011010, 00111, 
1001, 1100, 11101110, OL1011, 111011110, 111011111, 1110001, 001000, 1011010, 
01100, 10110110, 1011000, 101110, 142110, 111010, 1010, 1110110, 101111, 
11110, 0100, 00110, 1101, 001001, 111111, 0101, and 1000 and the average code- 
word length for the extended source is 4.7420. The entropy of the extended source 
is found to be 4.7097, so the efficiency of this Huffman code is 


which shows an improvement compared to the efficiency of the Huffman code de- 
signed in part 2. 


ILLUSTRATIVE PROBLEM 


Mustrative Problem 4.3 [A Huffman code with maximum efficiency] Design a Huff- 
man code for a source with probability vector 


PA a a de 1 1 
p a ar a Na ae I E 


E ouno 

We use the huffman.m function to determine a Huffman code and the corresponding 
average codeword length. The resulting codewords are 1, 01, 001, 0001, 00001, 000001, 
0000001, 00000000, and 00000001. The average codeword length is 1.9922 binary symbols 
per source output. If we find the entropy of the source using the entropy.m function, we see 


138 CHAPTER 4. ANALOG-TO-DIGITAL CONVERSION 


that the entropy of the source is also 1.9922 bits per source output: hence the efficiency of 
this code is 1. 





Can you say under what conditions the efficiency of a Huffman code is equal to 1? 


4.3 Quantization 


In the previous section we studied two methods for noiseless coding, i.e., compression of 
the source output sequence such that full recovery is possible from the compressed data. 
In these methods the compressed data is a deterministic function of the source output, and 
the source output is also a deterministic function of the compressed data. This one-to- 
one correspondence between the compressed data and the source output means that their 
entropies are equal and no information is lost in the encoding-decoding process. 

In many applications, such as digital processing of the analog signals, where the source 
alphabet is not discrete, the number of bits required for representation of each source output 
is not finite. In order to process the source output digitally, the source has to be quantized to 
a finite number of levels. This process reduces the number of bits to a finite number but at 
the same time introduces some distortion. The information lost in the quantization process 
can never be recovered. 

In general, quantization schemes can be classified as scalar quantization and vector 
quantization schemes. In scalar quantization each source output is quantized individually, 
whereas in vector quantization blocks of source output are quantized. 

Scalar quantizers can be further classified as uniform quantizers and nonuniform quan- 
tizers. In uniform quantization, the quantization regions are chosen to have equal length; in 
nonuniform quantization regions of various lengths are allowed. It is clear that, in general, 
nonuniform quantizers outperform uniform quantizers. 


4.3.1 Scalar Quantization 


In scalar quantization the range of the random variable X is divided into X nonoverlapping 
regions Ri, for] < i < N, called quantization intervals, and within each region a single 
point called a quantization level is chosen. Then ail values of the random variable that fall 
within region R; are quantized to the ith quantization level, which is denoted by <;. This 
means that 


x € Ri > Q(x) HK (4.3.1) 
where 
Åi E Ri (4.3.2) 


Obviously, a quantization of this type introduces a mean-square error of (x — %;)?. The 
mean-square quantization error is therefore given by 


N 
D= Ds J (x = &) fx (x) dx (4.3.3) 
1 IR 
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where fx (x) denotes the probability density function of the source random variable. The 
signal-to-quantization-noise ratio, (SQNR) is defined as 


E[x?] 





SQNR,,, = 10 logy 


Uniform Quantization 


In uniform quantization al! quantization regions except the first and the last one, i.e., Ri 
and Ry. are of equal length, which is denoted by A; therefore, 


Ry =, a] 
Rr = (a.u + A] 


Ry = (a+ A,a+2A) 





Ry = (a + (N —2)A, 00) 


The optimal quantization level in each quantization interval can be shown to be the centroid 
of that interval, i.e.. 


4 = E [XIX € Ri] (43.4) 
_ Sa, xfx) dx 


= = Isis N 

Ía, fx) dx 
Therefore, the design of the uniform quantizer is equivalent to determining a and A. Having 
determined a and A, the values of &,"s and the resulting distortion can be determined easily 
using Equations (4.3.3) and (4.3.4). In some cases it is convenient to choose the quantization 
levels to be simply the midpoints of the quantization regions, i.e., at a distance A /2 from 
the boundaries of the quantization regions. 

Plots of the quantization function Q(x) for a symmetric probability density function of 
X, and even and odd values of N are shown in Figures 4.3 and 4.4, respectively. 


For the symmetric probability density functions, the problem becomes even simpler. In 
such a case, 


R (ainail, 1sisN~) A 
' (i~i an), i=N 43.5) 
where 
ay = =œ% 
a =(i-N/DA 1<i<N-1 (4.3.6) 
ay = œ 
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Figure 4.4: The quantization function for N = 7. (Note that here %4 = 0.) 








Quanuzation iat 


We see that in this case we have only one parameter A, which we have to choose to 
achieve minimum distortion. Three m-files, centroid.m, mse-dist.m, and uq-dist.m, find 
the centroid of a region: the mean-square quantization error for a given distribution and 
given quantization region boundaries; and, finally, the distortion when a uniform quantizer 
is used to quantize a given source (it is assumed that the quantization levels are set to the 
centroids of the quantization regions). In order to use each of these m-files, the distribution 
of the source, which can depend on up to three parameters, has to be given in an m-file. 
These m-files are given below. 


e 


function y=centroid (funfcn,a,b,tol,pl,p2.p3) 

% CENTROID Finds the ceniroid of a function over a region 

Y = CENTROID(’F A.B, TOL.P1,P2,P3), finds the centroid of the 
function F defined in an m-file on the {A, B] region. The 
function can contain up ta three parameters, Pl, P2, P3 

tol = the relutive error 











nargin-4 
args=[args.* , p“ int2ste(n)): 
end 
args=(args.") “|: 






x.“ funfen}; 
yl=evak[' quad {funfcnl, a,b, tol, ií } args); 
y?seval[' quad funfcn, a.b. tol. |) *.args]): 
ysy!/y2: 


e 


function [y,dist]=mse_dist(funfen,a,tol,p!.p2.p3) 

&MSEDIST — Returns the mean-squared quantization error 
% {¥.DIST] = MSE_DIST1FUNFCN.A.TOL,P1,P2,P3) 
funfen = the distribution function given 

in an m-file It can depent on up ta three 
parameters, pl. p2. p3. 

a = the vector defining the boundaries of the 
quantization regions, (note: (atl), atlength(a)}} 
is the support of funfcn). 

pl. p2. p3 = parameters of funfen 

tol = the relative ermr 











RRAARKAAR 


args=[ J; 

for n=1:nargin—-3 
args=[args.’ . p’ int2strin)}: 

end 

args=[args.*) J: 

for i=1:length(a)—t 
y=eval([‘centroid(funten,a(i),a(i+l) , toi’ args)); 

end 





‘length(a)—1 
newfun=[‘ (x- (' num2str(y(i)). ) ) . ^2. * * funfcn); 
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dist=distteval (‘quad (newfun,a(i),a(i+l),col.{)’ args): 
end 


—===>—$£$______—__—__- 


fonction [y,dist]=uq-dist(funfen,b,c,n,delta,s,tol,p!,p2,p3) 
%UQ_DIST Returns the distortion of u uniform quantizer. 

% with quantization points set to the centroids. 
{¥,DIST]}=UQ_DIST( FUNFCN,B,C.N.DELTA,S,TOL,P 1. P2,P3) 
funfon=source density function given in an m-file 
with ut most three parameters, 1,p2,p3. 
[b,c}=The support of the source density function 
n=number of levels. 

deltuxlevel size, 

sethe lefimost quantization region boundary. 
pl.p2.pi=parameters of the input function 
y=quantizution levels. 

dist=distortion. 

tol=the relative error 








ARARLFARLRS 


if (cb<deltae(n—2)) i , 
error(' Too many levels for this range.’); retum 

end 

if (s<b) 4 
emor’ The leftmost boundary too small. '); retum 

end 

if (s+(n—-2)edelta>c) "3 
emor(' The leftmost boundary too large. '); retum 


—2}sdelta; 





a(n+t)=c; ; / 
(y.dist]=eval({‘mse_dist (funfen, a, tol‘ ,args]): 








ILLUSTRATIVE PROBLEM 


Tlustrative Problem 4.4 [Determining the centroids] Determine the centroids of the 
quantization regions for a zero-mean, unit variance Gaussian distribution, where the bound- 
aries of the quantization regions are given by (—5, —4, —2, 0, 1, 3, 5). 


-Em M 


The Gaussian distribution is given in the m-file normal.m. This distribution is a Micos 
of two parameters, the mean and the variance, denoted by m ands (oro), PE e 
support of the Gaussian distribution is (=00, oo), but for employing the aie ee 
it is enough to use a range that is many times the standard deviation of the dis A 
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For example, (m — 10/5, m + 10./s), can be used. The following m-file determines the 
centroids (optimal quantization levels). 








% MATLAB script for illustrative Problem 4. Chapter 4. 


a=[—10,—5,-4,—2,0,1,3,5,10); 

for i= 1:lengthta)—1 

y@W=centroid( normal *,a(i),atit1),0.001.0,1); 
end 





This results in the following quantization levels: (~5.1865, --4.2168, 2.3706, 0.7228, 
~0.4599, 1.5101, 3.2827, 5.1865) 


ILLUSTRATIVE PROBLEM 


Mlustrative Problem 4.5 In Illustrative problem 4.4 determine the mean-square error. 


im. SOLUTION J 


Letting a = (-10, 
square error of 0.177 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 4.6 [Uniform quantizer distortion] Determine the mean-square er- 
ror for a uniform quantizer with 12 quantization levels, each of length 1, designed for a 
zero-mean Gaussian source with variance of 4. It is assumed that the quantization regions 
are symmetric with respect to the mean of the distribution, 


fmm SOLUTION 


By the symmetry assumption the boundaries of the quantization regions are 0, +1, +2, 
+3, +4, +5, and the quantization regions are (oo, —5], (—5, —4), (-4, ~3], (-3, —2), 
(—2, -1), (-1, 0], (0,1), (1, 2], (2, 3}, (3, 4], (4, 5], and (5, +00). This means that in 
the uq-dist.m function we can substitute b = —20, ¢ = 20, A = In = 12,s = -5, 
tol = 0.001, p; = 0, and po = 2. Substituting these values into uq_dist.m we obtain a 
squared error distortion of 0.0851 and quantization values of £0.4897, + 1.4691, +2.4487, 
3.4286, 4.4089, and +5.6455. 

The m-file uq-mdpnt.m determines the squared error distortion for a symmetric density 
function when the quantization levels are chosen to be the midpoints of the quantization 
intervals. In this case the quantization levels corresponding to the first and the last quan- 
tization regions are chosen to be at distance A/2 from the two outermost quantization 
boundaries. This means that if the number of quantization levels is even, then the quantiza- 
tion boundaries are 0, +A, +2A,...,+(N/2 — 1) and the quantization levels are given 
by A/2, +3A/2,...,(N — 1)A/2. If the number of quantization levels is odd, then the 
boundaries are given by tA /2,£3A/2,..., (N/2—1)A and the quantization levels are 
given by 0, tA, 24, ..., (N — 1)A /2, The mfile ugq-mdpnt.m is given below. 








—5. —4, —2, 0.1, 3. 5, 10) and using mse.dist.m, we obtain a mean 
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e 


function disisuq-mdpnt(funfen,b,n,delta,tol.p1,p2,p3) 
WUQMDPNT Returns the distortion of a uniform quantizer 














% with quantization points set to the midpoinis 
% DIST=UQ_MDPNT(FUNFCN.B,N.DELTA,TOL.P1,P2.P3) 
% Junfen=source density function given in an m-file 

% with at most three parameters, pl.p2.p3. The density 
% function is assumed to be an even function 

% [-b.b}=The support of the source density function 

% nznumber of levels. 

% delu=level size 

% plp2.p3=parameters of the input function 

% distadisturtion 

% tol=the relative error. 


if (2xb<deltax(n—1)) 
emor(’Too many levels for this range.'). retum 





end 

args=[ N; 

for j=tinargin-5 
args=[args,’ , p* int2str(j)}: 

end 


args=[args,') ‘]; 





n 
a{isa(i— 1 )+delta; 
yi 1 )=afi)~deita/2; 
end 
y(n)=a(n)+delta; 
dist=0: 
for 151:n 
newfun=(’ tx- (* numdstr(y(i}).¢}) 72." funfenh, 
ist+eval({’ quad (newfun,a(i}.a(i+l},col, ()° args). 




















Illustrative Problem 4.7 [Uniform quantizer with levels set to the midpoints] Find the 
distortions when a uniform quantizer is used to quantize a zero-mean, unit variance Gaus- 
sian random variable. The number of quantization levels is 11, and the length of each 
quantization region is 1. 


$$ $_—_—_———_ 


In uq-mdpnt.m we substitute ‘normal’? for the density function name, pi = 0 and 
pz = | for the density function parameters, n = 11 for the number of quantization levels, 
and A = | for the length of the quantization levels. For the parameter 6, which chooses 





2The name of the function should be substituted with ‘normal’ including the single quotes. 
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the support set of the density function, we use the value b = 10p2 = 10. and we choose 
the tolerance to be 0.001. The resulting distortion is 0.0833. 


Nonuniform Quantization 


In nonuniform quantization the requirement that the quantization regions, except the first 
and the last, have equal lengths is relaxed, and each quantization region can have any length. 
Since in this case optimization is done under more relaxed conditions, the result is obviously 
superior to that of uniform quantization. The optimality conditions for this case, known as 
the Lloyd-Max conditions, can be expressed as 





fe xfy(x) dx 
fxi) dx 


+4) 
2 


(4.3.7) 


From these equations we conclude that the optimal quantization levels are the centroids 
of the quantization regions and the optimal boundaries between the quantization regions 
are the midpornts between the quantization levels. In order to obtain the solution to the 
Lloyd-Max equations, we start with a set of quantization levels ¢,. From this set we can 
simply find the set of quantization region boundaries a,. From this set of a;’s a new set 
of quantization levels can be obtained. This process is continued unti] the improvement in 
distortion from one iteration to another is not noticeable. This algorithm is guaranteed to 
converge to a local minimum, but in generat there is no guarantee that the global minimum 
can be achieved. 


The procedure of designing an optimal quantizer is shown in the m-file floydmax.m, 
given below. 


la — 


function {a,y.dist}=lloydmax(funfen.b,n,tol.p!.p2.p3) 
SLLOYDMAX Returns the the Lloyd-Mux quantizer and the mean-squared 








% quantization error for a symmeiric distribution. 

% {A.¥.DIST]=LLOYDMAX{ FUNFCN.B.N.TOLP1,P2,P3) 
% funfen=The density function given 

% in an m-file. It can depent on up to three 

% parameters, pl.p2.p3. 

% a=The vecior giving the boundaries of the 

% quantization regions. 

% {-b.b] approximates support of the density function. 
% n=The number of quantization regions. 

% yeThe quantization levels. 

% pl.p2.p3=Parameters of funfcn 

% tolzthe relative error. 

args=(]: 


for j=t:nargin-4 
args=(args,‘ , p’ int2str(j)}: 
end 


args=[args." ) "J; 
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veeval([’ variance (funfen, -b,b, tol’ args]); 
a(1)=-b; 
d=2+b/n; 
for 

afij=a{i—1)+d; 
end 














{y.newdist]seva(['mse_dist (funfen,a, tol’ args): 
while(newdist<0.99»dist), 

for i=2:n 

a(i=(Yi= N+ yi))/25 

end 

dist=newdise, 

(y,newdist]=eval(["mse_dist (funfen,a, tol’ args); 
end 


ILLUSTR E PROBLEM 


Illustrative Problem 4.8 [Lloyd-Max quantizer design) Design a 10-level Lloyd-Max 
quantizer for a zero-mean, unit variance Gaussian source. 


S$ _______— 


Using b = 10, n = 10, tol = 0.01, pı = 0, and pz = | in lloydmax.m, we obtain the 
quantization boundaries and quantization levels vectors a and y as 








a = +10, £2.16, £1.51, £0.98, +0.48, 0 
Yy = £2.52, £1.78, +1.22, £0.72, £0.24 


and the resulting distortion is 0.02. These values are good approximations to the optimal 
values given in the table by Max {2]. 


4.3.2 Pulse-Code Modulation 


In pulse-code modulation an analog signal is first sampled at a rate higher than the Nyquist 
rate, and then the samples are quantized. It is assumed that the analog signal is distributed 
on an interval denoted by [—xmax. max], and the number of quantization levels is large. 
The quantization levels can be equal or unequal. In the first case we are dealing with a 
uniform PCM and in the second case, with a nonuniform PCM. 


Uniform PCM 


In uniform PCM the interval [—xmax, Xmax] of length 2xmax is divided into N equal subinter- 
vals, each of length A = 2xmax/N. If N is large enough, the density function of the input 
in each subinterval can be assumed to be uniform, resulting in a distortion of D = 7/12. 
If N is a power of 2, or N = 2”, then v bits are required for representation of each level. 
This means that if the bandwidth of the analog signal is W and if sampling is done at the 
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Nyquist rate, the required bandwidth for transmission of the PCM signal is at least vW (in 
practice, 1.5vW is closer to reality). The distortion is given by 


D=— (4.3.8) 


If the power of the analog signal is denoted by XS, the signal-to-quantization-noise ratio 
(SQNR) is given by 








SQNR = 3N? -5 (4.3.9) 
Xmax 
xX? 
=3x4" 
=3 x1% 
where X denotes the normalized input defined by 
z x 
x =— 
Xmax 
The SQNR in decibels is given by 
SQNRy, © 4.8 + 6v + Xy (4.3.10) 


After quantization, the quantized levels are encoded using v bits for each quantized 
level. The encoding scheme that is usually employed is natural binary coding (NBC), 
meaning that the lowest level is mapped into a sequence of all 0’s and the highest level is 
mapped into a sequence of all 1's. All the other levels are mapped in increasing order of 
the quantized value. 


The m-file u_pcm.m given below takes as its input a sequence of sampled values and 
the number of desired quantization levels and finds the quantized sequence, the encoded 
sequence, and the resulting SQNR (in dcibels). 


SS 
function [sqnr,a.quan,code}=u_pcem(a,n) 

%U_PCM Uniform PCM encoding of a sequence. 

{SQNR.A_QUAN,CODE}] = UPCM(A.N) 

a = input sequence 

n = number of quantization levels (even) 

sqnr = output SQNR (in dB) 

quan = quantized output before encoding 

code = the encoded output 


RKRKKKR 
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amax=max(abs(a)); 
a_quan=a/amax; 
b.quan=a_quan; 
d=2/n, 
q=d.«(O:n—1]; 
geq—((n~1)/2)«d; 
for i=tin 

a.quan(find((qlij—d/2 <= aquan) & (a.quan <= qli)+d/2)))= 

(i) ones(t Jength(find((q(i)—d/2 <= a-quan) & (a_quan <= q{ij+d/2)))) 

b.quan(find( o_quan==q(i) ))=(i-1).«ones(1.length(find( a-quan==q{i) ))) 
end 
a_quan=a.quan*amax; 
nusceil(log2(n)); 
code=zeros(length(a)nu); 
for i=t:length(a) 

for j=nu:—1:0 

if ( fixtb-quan(i)/(27j)) == 1) 
code(i,(nu—j)) = 1; 
bequan(i) = b-quanti) — 27). 
end 

end 
end 
sqnr=20slog LO(norm(a)/norma—a_quan)); 


ILLUSTRATIVE PROBLEM 


Ilustrative Problem 4.9 [Uniform PCM] Generate a sinusoidal signa! with amplitude 1, 
and w = 1. Using a uniform PCM scheme, quantize it once to 8 levels and once to 16 
levels. Plot the original signal and the quantized signals on the same axis. Compare the 
resulting SQNRs in the two cases. 


Eni 


We arbitrarily choose the duration of the signal to be 10 s. Then using the u_pcm.m 
m-tile, we generate the quantized signals for the two cases of $ and 16 quantization levels. 
The resulting SQNRs are 18.90 dB for the 8-level PCM and 25.13 dB for 16-level uniform 
PCM. The plots are shown in Figure 4.5. 

A MATLAB script for this problem is shown below. 


aa 


% MATLAB script fur Illustrative Problem 9, Chapter 4 














echo on 

t=(0:0.01:10); 

assin(t), 

{sqnr8,aquan8,code8)=u_pcm(a.8), 

(sqnr!6,aquan 16,code L6}=upem(a,16);, 

pause % Press a key to see the SONR for N = & 

sqnr8 

pause % Press a key to see the SQNR for N = 16 

sqnrlé 

pause % Press u key to see the plot of the signal and its quantized versions 
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Figure 4.5: Uniform PCM for a sinusoidal signal using 8 and 16 levels. 
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plotit,a,fl-Al,t,aquan8,fl~ . £,t.aquan16,f-A.t,zeros( 1 Jength(t))) 


ILLUSTRATIVE PROBLEM 


Mlustrative Problem 4.10 [Uniform PCM] Generate a sequence of length 500 of zero- 
mean, unit variance Gaussian random variables. Using u_pcm.m, find the resulung SQNR 
when the number of quantization levels is 64. Find the first five values of the sequence, the 
corresponding quantized values, and the corresponding codewords. 


S$ $$$___________ 


The following m-file gives the solution. 











% MATLAB script for Mlustrative Problem 10. Chapter 4 


echo on 
a=randa(1,500); 

n=64; 

[sqnr,aquan,code}=u-pem(a,64); 

pause % Press u key to see the SONR. 


sqnr 
pause % Press a key to see the first five input values. 
a(1:5) 

pause % Press a key to see the first five quantized values. 
a_quan(1:5) 

pause % Press a key to see the first five codewords. 
code(1:5,:) 





In a typical running of this file, the following values were observed. 


SQNR = 31.66 dB 
Input = (0.1775, ~0.4540, 1.0683, -2.2541, 0.5376] 
Quantized vaiues = [0.1569, —0.4708, 1.0985, 2.2494, 0.5754] 


100001 
Ob OL 1 
Codewords={ 1 0 101 0 
006 1.0) 0 
1001 O1 


Note that different runnings of the program result in different values for the input, the 
quantized values, and the codewords. However the resulting SQNRs are very close. 
ILLUSTRATIVE PROBLEM 





Hlustrative Problem 4.11 In [llustrative Problem 4.10, plot the quantization error, defined 
as the difference between the input value and the quantized value. Also, plot the quantized 
value as a function of the input value. 


mi 
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Figure 4.6: Quantization error in uniform PCM for 64 quantization levels. 
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—E 


The two desired plots are shown in Figure 4.6. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 4.12 Repeat Illustrative Problem 4.11 with number of quantization 
levels set once to 16 and set once to 128, Compare the results. 


aam SOLUTION d 


The result for 16 quantization levels is shown in Figure 4.7, and the result for 128 
quantization levels is shown in Figure 4.8. 

Comparing Figures 4.6, 4.7, and 4.8, it is obvious that the larger the number of quantiza- 
tion levels, the smaller the quantization error, as expected. Also note that for a large number 
of quantization levels, the relation between the input and the quantized values tends to a 
line with slope | passing through the origin; i.e., the input and the quantized values become 
almost equal. For a small number of quantization levels (16 for instance), this relation is 
far from equality, as shown in Figure 4.7. 











Nonuniform PCM 


In nonuniform PCM the input signal is first passed through a nonlinear element to reduce its 
dynamic range. and the output is applied to a uniform PCM system. At the receiving end, 
the output is passed through the inverse of the nonlinear element used in the transmitter. 
The overall effect is equivalent to a PCM system with nonuniform spacing between levels. 
In general, for transmission of speech signals, the nonlinearities that are employed are either 
tt-law or A-law nonlinearities. 

A u-law nonlinearity is defined by the relation 


_ log + xii) 


= = 4.3.11 
y=g) lost! + x) gnia) l; ) 


where x is the normalized input (|x| < 1) and x is a parameter that in standard g-law 
nonlinearity is equal to 255. A plot of this nonlinearity for different values of is shown 
in Figure 4.9. 

The inverse of jz-law nonlinearity is given by 


es | 
x= Ct BE eit) (4.3.12) 


The two m-files mulaw.m and invmulaw.m given below implement j2-law nonlinearity and 
its inverse. 


“dum 


function [y,a}=mulaw(x,rmu) 





JoMULAW mu-law nonlinearity for nonuniform PCM. 
% Y = MULAW(X.MU) 
% X = input vector 
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Figure 4.7: Quantization error for 16 quantization levels. 
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Figure 4.9: The p-law compander. 


a=maxtabs(x)): 
y=(log(1+musabs(x/a)),/log(t+mu)).«signum(x); 
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ai 








function x=invmulaw(y,mu) 
%eINVMULAW The inverse of mu-law nonlineurity 
PX=INVMULAWY MU) Y = Normalized outpus of the mu-law nonlinearity 


x=(((1+mu).”(abs(y))—1)./mu).«signum(y); 





The m-file mula_pcm.m is the equivalent of the m-file u.pem.m when using a u-law 


PCM scheme. This file is given below. 








function (sqor,a.quan,code]=mula_pem(a,n,mu) 


Figure 4.8: Quantization error for 128 quantization levels. 





%MULA_PCM mu-luw PCM encoding of a sequence. 

% [SQNR.A_QUAN,CODE] = MULA_PCM(A.N,MU} 
% a = input sequence 

% n = number of quantization levels {even) 

% sqnr = output SONR {in dB) 
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% aguan = quantized output before encoding 
% code = the encoded output 


[y,maximum]=mulaw(a,mu), 
{sqnr.y_q,code}=u_pem(y.n); 
a_quan=invmulaw(y_q,mu); 
a_quan=maximumsa.quan; 
sqnr=20slog 1 0(norm(a)/norm(a—a_quan)); 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 4.13 {[Nonuniform PCM] Generate a sequence of random variables 
of length 500 according to an W (0, 1) distribution. Using 16, 64, and 128 quantization 
levels and a y-law nontinearity with y = 255, plot the error and the input-output relation 
for the quantizer in each case. Also determine the SQNR in each case. 


<E 


Let the vector a be the vector of length 500 generated according to N (0, t), i.e., let 











a = randn(500) 
Then by using 
[dist,a_quan,code] = mula-pem(a, 16, 255) 


we can obtain the quantized sequence and the SQNR for a 16-level quantization. The SQNR 
will be 13.76 dB. For the case of 64 levels we obtain SQNR = 25.89 dB, and for 128 levels 
we have SQNR = 31.76 dB. Comparing these results with the uniform PCM, we observe 
that in all cases the performance is inferior to the uniform PCM. Plots of the input-output 
relation for the quantizer and the quantization error are given in Figures 4.10, 4.11, and 
4.12. 

Comparing the input-output relation for the uniform and the nonuniform PCM shown 
in Figures 4.7 and 4.10 clearly shows why the former is called uniform PCM and the latter 
is called nonuniform PCM. 


From the above example we see that the performance of the nonuniform PCM, in this 
case, is not as good as uniform PCM. The reason is that in the above example the dynamic 
range of the input signal is not very large. The next example examines the case where the 
performance of the nonuniform PCM is superior to the performance of the uniform PCM. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 4.14 The nonstationary sequence a of length 500 consists of two 
parts. The first 20 samples are generated according to a Gaussian random variable with 
mean 0 and variance 400 (a = 20), and the next 480 samples are drawn according to a 
Gaussian random variable with mean 0 and variance 1. This sequence is once quantized 
using a uniform PCM scheme and once using a nonuniform PCM scheme. Compare the 
resulting SQNR in the two cases. 
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Figure 4.10: Quantization error and input-output relation for a 16-level jz-law PCM. 
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Figure 4.11: Quantization error and quantizer input-output relation for a 64-level u-law 
PCM. 
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Figure 4.12: Quantization error and quantizer input-output relation for a 128-level p-law 
PCM. 
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Ei 


The sequence is generated by the MATLAB command 





a = (20 * randn(1, 20)randn(1, 480)] 


Now we can apply the u-pem.m and the mula_pem.m files to determine the resulting SQNR. 
The resulting SQNRs are 20.49 dB and 24.95 dB, respectively. In this case the performance 
of the nonuniform PCM is definitely superior to the performance of the uniform PCM. 
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Problems 


4.1 Design a Huffman code for an information source with probabilities 
p = {0.1, 0.05, 0.21, 0.07, 0.02, 0.2, 0.2, 0.15} 


Determine the efficiency of the code by computing the average codeword Iength and the 
entropy of the source. 


4.2 A discrete-memoryless information source is described by the probability vector p = 
(0.2, 0.3, 0.1, 0.4} 


a. Write a MATLAB file to compute the probabilities of the K th extension of this source 
for a given K 


b. Design Huffman codes for this source and its Kth extensions for K = 1, 2,3, 4,5. 
c. Plot the average codeword length (per source output) as a function of K. 


4.3 The probabilities of the letters of the alphabet occurring in printed English are given in 
Table 4.1. 


a. Determine the entropy of printed English. 
b. Design a Huffman code for printed English. 
c. Determine the average codeword length and the efficiency of the Huffman code. 


4.4 Repeat Problem 4.2 for a discrete-memoryless source with a probability vector p = 
{0.5, 0.25, 0.125, 0.125}. Explain why the result in this case is different from the result 
obtained in Problem 4.2. 


4.5 A continuous information source has a zero-mean, unit variance Gaussian distribution. 
This source is quantized using a uniform symmetric quantizer, where the length of the quan- 
tization regions is unity. The number of quantization levels is N. For N = 2,3, 4, 5,6,7,8, 
determine the entropy of the quantized source output and piot it as a function of N. On the 
same graph plot log, versus N and explain why the two curves differ. 


4.6 A zero-mean, unit variance Gaussian source is quantized using a uniform quantizer. 
The quantizer uniformly quantizes the interval (—10, 10]. Assuming the quantization levels 
are located at midpoints of the quantization regions, determine and ptot the mean square 
distortion for N = 3,4,5,6,7, 8,9, 10 as a function of N, the number of quantization 
levels. 


4.7 On the same figure that you plotted in Problem 4.6, plot the mean square distortion 
when the quantization levels are taken to be the centroids of the quantization regions. For 
what values of N are the two plots closer and why? 
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4.8 For a zero-mean, unit variance Gaussian source, design optimal nonuniform quantizers 
with a number of levels N = 2, 3,4, 5,6, 7, 8. For each case determine H(X), the entropy 
of the quantized source, and R, the average codeword length of a Huffman code designed 
for that source. Plot H(X), R, and log, NV as a function of N on the same figure. 


4.9 A Laplacian random variable is defined by the probability density function 















































—— oe ee es i 
Letter Probability fix) = sent 
A 0.0642 < 
B 0.0127 where à > 0 is a given constant. 
C 0.0218 
D 0.0317 a. Verify that the variance of a Laplacian random variable is equal to 2/A?. 
0.1031 
E 0.0208 b. Assuming à = 1, design uniform quantizers with N = 2, 3,4, $, 6,7, 8 levels for 
G 00157 this source. As usual, take the interval of interest to be [- 100, 100] where o is the 
H oor | standard deviation of the source. 
I 0.0575 c. Plot the entropy of the quantized source and log) N as functions of N on the same 
J 0.0008 figure. 
K 0.0049 
È 0.0321 4.10 Repeat Problem 4.9, substituting the uniform quantizer with the optimal nonuniform 
M 0.0198 quantizer. 
N 0.0574 
O 0.0632 4.11 Design an optimal 8-leve! quantizer for a Laplacian source and piot the resulting 
P 0.0152 mean-square distortion as a function of 4 as A changes in the interval {0.1, 5]. 
Q 0.0008 
R 0.0484 4.12 Design optimal nonuniform quantizers with N = 2, 3, 4, 5, 6, 7, 8 for the Laplacian 
S 0.0514 source given in Problem 4.9 with a à = vZ (note that this choice of A results in a Zero- 
T 0.0796 mean, unit variance Laplacian source). Plot the mean-square error as a function of N for 
U 0.0228 this source. Compare these results with those obtained from quantizing a zero-mean, unit 
y 0.0083 variance Gaussian source. 
WwW 0.0175 peat 5 i P F 
}——— 4.13 The periodic signal x(t) has a period of 2 and in the interval {0, 2] is defined as 
X 0.0013 Pe P 
Y 0.0164 a jatsi 
Z 0.0005 x(t) = Aa 3 
Word space | 0.1859 mR lgis 
Table 4.1: Probabilities of letters in printed English. a. Design an 8-level uniform PCM quantizer for this signal and plot the quantized output 


of this system. 
b. Plot the quantization error for this system. 


c. By calculating the power in the error signal, determine the SQNR for this system in 
decibels. 


d. Repeat parts a, b, and c using a 16-level uniform PCM system. 
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4.14 Generate a Gaussian sequence with mean equal to 0 and variance equal to 1 with 1000 
elements. Design 4-level, 8-level, 16-level, 32-level, and 64-level uniform PCM schemes 
for this sequence and plot the resulting SQNR (in decibels) as a function of the number of 
bits allocated to each source output. 


4.15 Generate a zero-mean, unit variance Gaussian sequence with a length of 1000 and 
quantize it using a 6-bit-per-symbol uniform PCM scheme. The resulting 6000 bits are 
transmitted to the receiver via a noisy channel. The error probability of the channel is 
denoted by p. Plot the overall SQNR in decibels as a function of p for values of p = 
1073, 5 x 1073, 1072, 5 x 1077, 0.1, 0.2. For simulation of the effect of noise, you can 
generate binary random sequences with these probabilities and add them (modulo 2) to the 
encoded sequence. 


4.16 Repeat Problem 4.13 using a nonuniform y-law PCM with u = 255. 
4.17 Repeat Problem 4.14 using a nonuniform -law PCM with x = 255 


4.18 Repeat Problem 4.15 using a nonuniform -law PCM with u = 255. 


Chapter 5 


Baseband Digital Transmission 


5.1 Preview 


In this chapter we consider several baseband digital modulation and demodulation tech- 
niques for transmitting digital information through an additive white Gaussian noise chan- 
nel. We begin with binary pulse modulation and then we introduce several nonbinary 
modulation methods. We describe the optimum receivers for these different signals and 
consider the evaluation of their performance in terms of the average probability of error. 


5.2 Binary Signal Transmission 


In a binary communication system, binary data consisting of a sequence of 0’s and 1’s are 
transmitted by means of two signal waveforms, say, so(t) and s(t). Suppose that the data 
rate is specified as R bits per second. Then, each bit is mapped into a corresponding signal 
waveform according to the rule 


where Th = 1/R is defined as the bit time interval. We assume that the data bits O and 
1 are equally probable. i.e., each occurs with probability b and are mutually statistically 
independent. 

The channel through which the signal is transmitted is assumed to corrupt the signal 
by the addition of noise, denoted as n(t), which is a sample function of a white Gaussian 
process with power spectrum No/2 watts/hertz. Such a channet is called an additive white 
Gaussian noise (AWGN) channel. Consequently, the received signal waveform is expressed 
as 


r(t) =si(t) +n(t), i=0,1, Ost Ta (5.2.1) 


165 
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The task of the receiver is to determine whether a D or a | was transmitted after observing 
the received signal r(r) in the interval O < ¢ < Tp. The receiver is designed to minimize 
the probability of error. Such a receiver is called the optimum receiver. 


5.2.1 Optimum Receiver for the AWGN Channel 


In nearly all basic digital communication texts, it is shown that the optimum receiver for 
the AWGN channel consists of two building blocks. One is either a signal correlator ot a 
matched filter. The other is a detector. 

5.2.2 Signal Correlator 

The signal correlator cross-correlates the received signal r(r) with the two possible trans- 


mitted signals s(t) and s(t), as illustrated in Figure 5.1. That is, the signal correlator 
computes the two outputs 


t 
no= f r(t)so(t}dt 
0 
t 
nG) =f r(t)si(t)dt (5.2.2) 
0 


in the interval O <r < Th, samples the two outputs at? = Tp and feeds the sampled outputs 
to the detector. 
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Figure 5.1: Cross correlation of the received signal r(t) with the two transmitted signals. 





Mlustrative Problem 5.1 Suppose the signal waveforms so(t) and sı (r) are the ones shown 
in Figure 5.2, and let so(r) be the transmitted signal. Then, the received signal is 
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167 
Sy) 
ais 
oj T, ‘ 
Figure 5.2: Signal waveforms so(t) and sı (t) for a binary communication system. 
F(t) = y(t) + (ry, O<:<% (5.2.3) 


Determine the correlator outputs at the sampling instants. 


—CE 


When the signal r (7) is processed by the two signal correlators shown in Figure 5.1, the 
outputs rg and r; at the sampling instant t = Tp are 





Th 
n= f r(t)so(t} dt 
0 


Th Th 
=f sear + f nit)so(t) dt 
0 0 


=E +n (5.2.4) 


and 


Th 
n= f oaod 
0 


Th Th 
f owsa f n(t)si(t)dt 
0 o 


=ni (5.2.5) 


where ng and nj are the noise components at the output of the signal correlators, ie., 
Th 
n = f n(t)so(t) dt 
0 


To 
ni =f n(t)si(t) dt (5.2.6) 
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and £ = A?7, is the energy of the signals so(r) and s;(t). We also note that the two signal 
waveforms are orthogonal, i.e., 


Th 
f ; So(t)si(t}dt = 0 (5.2.7) 
0 


On the other hand, when s)(r) is the transmitted signal, the received signal is 
r(t) = si(t)+n(t), O<t<T 
It is easy to show that, in this case, the signal corretator outputs are 


ro = no 
n=£+n (5.2.8) 


Figure 5.3 illustrates the two noise-free correlator outputs in the interval 0 < £ < Th for 
each of the two cases—i.e., when sq(t) is transmitted and when s; (¢) is transmitted. 


Output of 
Correlator 0 


Output of Output of Output of 
Correlator | Correlator 0 Correlator | 








ni 











(ay {b) 


Figure 5.3; Noise-free correlator outputs. (a) so(t) was transmitted. (b) s; (£) was transmit- 
ted. 


Since n(t) is a sample function of a white Gaussian process with power spectrum No/2, 
the noise components ng and n, are Gaussian with zero means, i.€., 


Th 
E(no) -Í solt) E (n(t)] dt =0 
0 


Th 
En) =f ” SME [n()] dt =0 (629) 
0 


and variances a7, for i = 1, 2, where 
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= E{n?) 


Ta pT 
=f f 5i(t)si(t)E[n(t)n(t)] dt dt 
o Jo 


No pT 
=f Si(t)s;(t)5(t — tr) dtdt 
2 Jo 


No fa 

-2f sodi (5.2.10) 
2 Jo 
EN 

===. i=0.1 (5.2.11) 


Therefore, when so(t) is transmitted, the probability density functions of ro and r) are 


enor £)?/2a7 
2no 


p{ro | solt) was transmitted) = 


p(ry | soft) was transmitted) = enh ita? (5.2.12) 





2mo 


These two probability density functions, denoted as p(ro | 0) and p(r, | 0), are illustrated 
in Figure 5.4. Similarly, when sı (r) is transmitted, ro is zero-mean Gaussian with variance 
a? and rı is Gaussian with mean value £ and variance o? 








Figure 5.4: Probability density function p(rọ | 0) and p(r; | 0) when so(t) is transmitted. 


5.2.3 Matched Filter 


The matched filter provides an alternative to the signal correlator for demodulating the 
received signal r(z). A filter that is matched to the signal waveform s(t), O <t < Th, 
has an impulse response 


A(t) = s(Th — t), 0<stsTh (5.2.13) 
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Consequently, the signal waveform—say, y(t)—at the output of the matched filter when 
the input waveform is s(t) is given by the convolution integral 
r 
y= f s(t)h(t —t)dt (5.2.14) 
o 


If we substitute in (5.2.14) for A(t — t) from (5.2.13), we obtain 


t 
o= f s(T)s(Th—t+r)di (5.2.15) 


and if we sample y(t) att = Th, we obtain 


T, 
(Tp) =f Sdt =E (5.2.16) 
0 


where £ is the energy of the signal s(r). Therefore, the matched filter output at the sampling 
instant £ = Th is identical to the output of the signal correlator. 


ILLUSTRATIVE PROBLEM 


Mlustrative Problem 5.2 Consider the use of matched filters for the demodulation of the 
two signal waveforms shown in Figure 5.2 and determine the outputs. 


im SOLUTION a 


The impulse responses of the two matched filters are 








holt) = so(Th — t) 
hi = s(t) (5.2.17) 


as illustrated in Figure 5.5. Note that each impulse response is obtained by folding the signal 
s(t) to obtain s(—r) and then delaying the folded signal s(—r) by Ta to obtain s(Tp — t). 

Now suppose the signal waveforms sg(t) is transmitted. Then, the received signal 
r(t) = solt) + n(r) is passed through the two matched filters. The response of the filter 
with impulse response Ag(t) to the signal component so(t) is illustrated in Figure 5.6(a). 
Also, the response of the filter with impulse response h; (¢) to the signal component so(t) 
is illustrated in Figure 5.6(b). Hence, at the sampling instant ¢ = Tp, the outputs of the two 
matched filters with impulse responses Ag(t) and A, (t) are 


m= £ +n 
ran (5.2.18) 


respectively. Note that these outputs are identical to the outputs obtained from sampling 
the signal correlator outputs at t = T. 
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holt) = 5,(7, — 0 A(t) = 5,7, - 9 





Figure 5.5: Impulse responses of matched filters for signals so{t) and s; (t). 


PAO] 








(b) 


Figure 5.6: Signa! outputs of matched filters when So(t) is transmitted. 
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5.2.4 The Detector 


The detector observes the correlator or matched filter outputs rg and z; and decides on 
whether the transmitted signal waveform is either so(t) or s(t), which correspond to the 
transmission of either a Qor a 1, respectively, The optimum detector is defined as the detector 
that minimizes the probability of error. 
ILLUSTRATIVE PRI LEM 








Illustrative Problem 5.3 Let us consider the detector for the signals shown in Figure 5.2, 
which are equally probable and have equal energies. The optimum detector for these signals 
compares ro and z; and decides that a O was transmitted when rp > rı and that a | was 
transmitted when r; > ro. Determine the probability of error. 


-em m 


When so(r) is the transmitted signal waveform, the probability of error is 
P, = P(r, > ro) = P(n > E +n) = P(n ~no > £) (5.2.19) 


Since n; and no are zero-mean Gaussian random variables, their difference x = n; — no is 
also zero-mean Gaussian. The variance of the random variable x is 


E(x?) = Elni — no)?] = E(nj) + Elng) — 2E (a1 no) (5.2.20) 


But E(nino) = 0, because the signal waveforms are orthogonal. That is, 





Th Tt 
E(nj no) = ef f so(t}s ()n(t)n(r) dt dt 
o Jo 
Th pte 
= Xf f soltsilr)ê — t)dedr 
2 Jo Jo 
Th 
= =f solis (th de 
2 Jo 
=0 (5.2.21) 
Therefore, 
E(x?) =2 (=) =EN 20? (5.2.22) 
Hence, the probability of error is 
1 eo 270} 
Pe = J et Per dx 
© Simos Je 
zál E eh dx 
van J YETNo 


E 
z E 5.2.23 
( =) (5223) 
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The ratio £/No is called the signal-to-noise ratio (SNR). 














1Ologig £/No 


Figure 5.7: Probability of error for orthogonal signals. 


The derivation of the detector performance given above was based on the transmission 
of the signal waveform so(t}. The reader may verify that the probability of error that is 
obtained when s){t) is transmitted is identical to that obtained when sg(t) is transmitted. 
Because the O's and 1’s in the data sequence are equally probable, the average probability 
of error is that given by (5.2.23). This expression for the probability of error is evaluated 
by using the MATLAB script given below and is plotted in Figure 5.7 as a function of the 
SNR, where the SNR is displayed on a logarithmic scale (10logjy £/No). As expected, 
the probability of error decreases exponentially as the SNR increases. 


-ena 


% MATLAB script that generutes the probability of error versus the signal-to-noise ratio 
initial_snr=0; 
final_snr=15; 
snr_step=0.25: 





snr_in_dB=initial_sor:snr_step:final_snr, 

for i=1:length(snr_in.dB), 
snr=107(snr_in-dB(i)/10); 
Pe(i=Qfunct(sqrt(snr)); 

end; 

semilogy(snr-in.dB,Pe); 
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5.2.5 Monte Carlo Simulation of a Binary Communication System 


Monte Carlo computer simulations are usually performed in practice to estimate the proba- 
bility of error of a digital communication system, especially in cases where the analysis of 
the detector performance is difficult to perform. We demonstrate the method for estimating 
the probability of error for the binary communication system described above. 


ILLUSTRATIVE PROBLEM 


Tlustrative Problem 5.4 Use Monte Carlo simulation to estimate and plot P, versus SNR 
for a binary communication system that employs correlators or matched tilters. The model 
of the system is illustrated in Figure 5.8. 
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Figure 5.8; Simulation model for Illustrative Problem 5.4. 


fem SOLUTION aes 


We simulate the generation of the random variables ro and rj, which constitute the 
input to the detector. We begin by generating a binary sequence of 0's and 1's that occur 
with equal probability and are mutually statistically independent. To accomplish this task, 
we use a random number generator that generates a uniform random number with a range 
(0, 1). If the number generated is in the range (0, 0.5), the binary source output is a 0. 
Otherwise, itis a 1, If a 0 is generated, then ro = £ + no andr; = n}. Ifa] is generated, 
then ro = ng and ry = E +n}. 

The additive noise components no and n; are generated by means of two Gaussian noise 
generators, Their means are zero and their variances are o? = £ No/2. For convenience, 
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we may normalize the signal energy £ to unity (£ = 1) and vary a7. Note that the SNR, 
which is defined as £ /Np, is then equal to 1/207. The detector output is compared with 
the binary transmitted sequence, and an error counter is used to count the number of bit 
errors. 

Figure 5.9 illustrates the results of this simulation for the transmission of N=10,000 
bits at several different values of SNR. Note the agreement between the simulation results 
and the theoretical value of P, given by (5.2.23). We should also note that a simulation 
of N=10,000 data bits allows us to estimate the error probability reliably down to about 
P, = 107%. In other words, with N=10,000 data bits, we should have at least 10 errors for 
a reliable estimate of P,. MATLAB scripts for this problem are given below. 





% MATLAB script for Mluscrative Problem 4. Chapter 5. 
echo on 
SNRindB1=0:1:12; 
SNRindB2=0:0.1:12: 
for i=1:length(SNRindB |), 
% simulated error rate 
smld_err_prb(i}=smidPeS4(SNRindB Lay), 
end; 
for i=1:length(SNRindB2), 
SNR=exp(SNRindB2(i)slog¢ 10)/ 10); 
% theoretical error rate 
theo.ert_prb(i}=Qfunct(sqrt(SNR)); 
end: 
% ploning commands fallow 
semilogy(SNRindB | smid_ert_prb.’ * °); 
hold 
semilogy(SNRindB2 theo_err_prb): 


e 


function [p]=smldPeS4(snr_in_dB) 
% fp} = smidPe54isnr in AB) 
% SMLDPES4 finds the probability of error for the given 

















% snrandB. signal-to-noise ratia in dB. 
E=1; 
SNR=exp(snr_in_d8 «log(10)/ 10); % signal-to-noise ratio 
sgma=E/sqrt(2*SNR); % sigma, standard deviation of noise 
N=10000; 
% generation of the binary data source 
for i=1:N. 
temp=rand, % u uniform random variable over (0,1) 
if (temp<0.5), 
dsource(i)=0, % with probability 1/2, source output is 0 
else 
dsource(i)=1; % with probability 1/2, source output is 1 
end 
end, 
% detection. and probability of errar calculation 
numoferr=0; 
for i=1:N, 
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% matched filter outputs 
if (dsource(i}==0), 
10=E+gngauss(sgma); 
r{=gngauss(sgma); % if the source output is “O” 
else 
rO=gngauss(sgma); 
r]=E+gngauss(sgma); % if the source output is “I” 
end; 
% detector follows 
if (rO>rl), 
decis=0; % decision is “0” 
else 
decis=1; % decision is “I” 
end; 
if (decis“=dsource(i)), % if it is an error, increase the error counter 
numoferr=numoferr+1, 
end; 
end; 
p=numoferr/N; % probability of error estimate 
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Figure 5.9: Error probability from Monte Carlo simulation compared with theoretical error 
probability for orthogonal signaling. 


-enm 


In Figure 5.9, simulation and theoretical results completely agree at low signal-to-noise 
ratios, whereas at higher SNRs they agree less. Can you explain why? How should we 
change the simulation process to result in better agreement at higher signal-to-noise ratios? 
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5.2.6 Other Binary Signal Transmission Methods 


The binary signal transmission method described above was based on the use of orthogonal 
signals. Below, we describe two other methods for transmitting binary information through 
a communication channel. One method employs antipodal signals. The other method 
employs an on-off-type signal. 


5.2.7 Antipodal Signals for Binary Signal Transmission 


Two signal waveforms are said to be antipodal if one signal waveform is the negative of the 
other. For example, one pair of antipodal signals is illustrated in Figure 5.10(a). A second 
pair is illustrated in Figure 5.10(b). 























(a) A pair of antipodal signals (b) Another pair of antipodal signals 


Figure 5.10: Examples of antipodal signals. (a) A pair of antipodal signals. {b} Another 
pair of antipodal signals. 


Suppose we use antipodal signal waveforms sg(t) = s(t} and sı (r) = —s(r) to transmit 
binary information, where s(t) is some arbitrary waveform having energy £. The received 
signal waveform from an AWGN channel may be expressed as 

r{t) = £s(t) + n(t), O<:1<%, (5.2.24) 

The optimum receiver for recovering the binary information employs a single correlator or 

a single matched filter matched to s(t), followed by a detector, as illustrated in Figure 5.11. 
Let us suppose that s(¢) was transmitted, so that the received signal is 

r(t) = s(t) +n(t) (5.2.25) 


The output of the correlator or matched filter at the sampling instant ¢ = Tp is 


r=E£E+n (5.2.26) 
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where £ is the signal energy and n is the additive noise component, which is expressed as 


Th 
n -f n(t)s(t) dt (5.2.27) 
0 


Received Matched filter 
signal r(1) Sho 


(a) Matched filter demodulator 
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Figure 5.11: Optimum receiver for antipodal signals. (a) Matched filter demodulator. (b) 
Correlator demodulator. 


Since the additive noise process n(t} is zero mean, it follows that E(x) = 0. The 
variance of the noise component n is 


o? = E(n?) 


Th pty 
f f E[n(t)n(t)] s(t)s(t) dt drt 
0 0 


It 


Th Th 
No i di df — t)s(t)s(t)dtdr 
2 Jo Jo 


No 
2 


iH 


Th 
f "Saar = Moe (5.2.28) 
0 


Consequently, the probability density function of r when s(t) is transmitted is 


2/292 
e FEY [20 





P(r | s(t) was transmitted) = p(r | 0) = (5.2.29) 


ving 
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Similarly, when the signal waveform ~s(t) is transmitted, the input to the detector is 


r=-E+n (5.2.30) 


and the probability density function of r is 





pír | —5(t) was transmitted) = p(r | 1) = e70 +E 20? (5.2.31) 


no 


These two probability density functions are illustrated in Figure 5.12. 


pen 








Figure 5.12: Probability density function for the input to the detector. 


For equaily probable signal waveforms, the optimum detector compares r with the 
threshold zero. If r > 0, the decision is made that S(t) was transmitted. If r < 0, the 
decision is made that —s(f} was transmitted. 

The noise that corrupts the signal causes errors at the detector. The probability of a 
detector error is easily computed. Suppose that s(t) was transmitted. Then the probability 
of error is equal to the probability that r <0; i.e., 





P, = P(r <0) 
= ! p eC EV No? gp 
vV2n 0 J-% 
= 
= = C Phar 
n Jo 
Z 
-o(Z 
o 
2E 
=Q ( 2) (5.2.32) 
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A similar result is obtained when —s(r) is transmitted. Consequently, when the two 
signal waveforms are equally probable, the average probability of error is given by (5.2.32). 

When we compare the probability of error for antipodal signals with that for orthogonal 
signals given by (5.2.23), we observe that, for the same transmitted signal energy £, 
antipodal signals result in better performance. Alternatively, we may say that antipodal 
signals yield the same performance (same error probability) as orthogonal signals by using 
one-half of the transmitted energy of orthogonal signals. Hence, antipodal signals are 3 dB 
more efficient than orthogonal signals. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 5.5 Use Monte Carlo simulation to estimate and plot the error prob- 
ability performance of a binary antipodal communication system. The model of the system 
is illustrated in Figure 5.13. 
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Figure 5.13: Model of the binary communication system employing antipodal signals. 





-ED 


As shown, we simulate the generation of the random variable r, which is the input to the 
detector. A uniform random number generator is used to generate the binary information 
sequence from the binary data source. The sequence of O's and 1's is mapped into a sequence 
of +E, where E represents the signal energy. £ may be normalized to unity. A Gaussian 
noise generator is used to generate the sequence of zero-mean Gaussian random numbers 
with variance o?, The detector compares the random variable r with the threshold of 0. If 
r > 0, the decision is made that the transmitted bit is a 0. If r < 0, the decision is made 
that the transmitted bit is a 1. The output of the detector is compared with the transmitted 
sequence of information bits, and the bit errors are counted. Figure 5.14 illustrates the 
results of this simulation for the transmission of 10,000 bits at several different values 
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of SNR. The theoretical value for P, given by (5.2.32) is also plotted in Figure 5.14 for 
comparison. The MATLAB scripts for this problem are given below. 


ai 


Fo MATLAB script for Hiustrated Problem 5. Chapter 5. 
echo on 

SNRindBi=0:1:10; 

SNRindB2=0-0.1:10: 

for i=tlength(SNRindB |), 








% sumulated ern rate 
smld_err_prb(i)=smidPeS5{SNRindB 1{i)): 
end: 


for i=t-tength(SNRindB2), 
SNR=exp(SNRindB2i)«logr 10)/ 10: 
% theoretical error rate 
theo_err_prb(i)=Qfunet(sqr 2*#SNR)), 

end, 

% plotting commands follow 

semilogy(SNRindB I! smld_ertprb.°*"), 

hold 

semilogy(SNRindB2,theo_err_prb); 


aia» 


function [p}=smidPe35(snr_in_dB) 
% ip] = smidPeSStsnr in dB) 
% SMLDPESS simulates the probubility of error for the particular 




















% value of sarsndB, signal-to-noise ratio in dB. 
E=1; 
SNR=expisar_in.dBslog(10)/10); % signal-to-noise rativ 
sgma=E/sqr(2*SNR}: % sigma, standard deviation of noise 
N=10000; 
% generation of the binary data source follows 
for i=1:N, 
temp=rand; % u uniform random variable over (0.1) 
if (temp<0.5). 
dsource(i): % with probability 1/2, source output is O 
else 
dsource(i)=1; % with probability 1/2, source output is 1 
end 
end: 
% the detection, und probability of error cuiculation follows 
numoferr=0; 
for 1=1:N. 


% The matched filter outputs 
if (dsource(i)==0), 





1=—E+gngauss(sgma); % if the source output is “0” 
else 

r=E+gngauss(sgma); % if the source output is 
end; 
% detector follows 
if {r<0), 

decis=0; % decision is “0” 
else 
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decis=1; % decision is "1" 
end; 
if (decis"=dsource(i)), % if it is an error, increase the error counter 
numoferr=numoferr+1; 
end; 
end; 
p=numoferr/N; % probubility of error estimate 
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Figure 5.14: Error probability from Monte Carlo simulation compared with theoretical 
error probability for antipodal signals. 


5.2.8 On-Off Signals for Binary Signal Transmission 


A binary information sequence may also be transmitted by use of on-off signals. To trans- 
mit a 0, no signal is transmitted in the time interval of duration Tp. To transmit a 1, a 
signal waveform s(r) is transmitted. Consequently, the received signal waveform may be 
represented as 


a(t), if a O is transmitted 
r(t)= 


= : 5 S (5.2.33) 
s(t) +n(t), ifa lis transmitted 


where n(t) represents the additive white Gaussian noise. 
As in the case of antipodal signals, the optimum receiver consists of a correlator or 
a matched filter matched to s(t), whose output is sampled at t = Ty, and followed bya 
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detector that compares the sampled output to the threshold, denoted as æ. Ifr > æ, a Lis 
declared to have been transmitted; otherwise, a 0 is declared to have been transmitted. 
The input to the detector may be expressed as 


n, if 0 is transmitted 


r= 5.2.34 
£+n, ifal is transmitted 6 ) 


where n is a zero-mean, Gaussian random variable with variance a? = E No/2. Therefore, 
the conditional probability density functions of the random variable r are 
1 


210 
l 


2na 





prio = er na? if a O is transmitted 


prii) = eV EN 





if a I is transmitted 


These probability density functions are illustrated in Figure 5.15. 








Figure 5.15: The probability density function for the received signal at the output of the 
correlator for on-off signals. 


When a 0 is transmitted, the probability of error is 





if 2. 2 
Pala) = P(r > a) = ean f e7 No? dr (5.2.35) 
O Ja 


where œ is the threshold. On the other hand, when a | is transmitted, the probability of 
error is 


Pala) = P(r <a) = 





or E}/202 
f e dr (5.2.36) 
220 J- 


Assuming that the binary information bits are equally probable, the average probability of 
error is 
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l l 
Pea) = 3 vola) + 3 Pei(a) (5.2.37) 
The value of the threshold « that minimizes the average probability of error is found by 


differentiating P.(a) and solving for the optimum threshold. It is easily shown that the 
optimum threshold is 


(5.2.38) 


tual 


Goon = 


Substitution of this optimum value into (5.2.35), (5.2.36), and (5.2.37) yields the probability 


of error 
t 
Pe(Gopt) = Q ( la) (5.2.39) 


We observe that error-rate performance with on-off signals is not as good as antipodal 

signals. It appears to be 6 dB worse than antipodal signals and 3 dB worse than orthogonal 

signals. However, the average transmitted energy for the on-off signals is 3 dB less than 

that for antipodal and orthogonal signals. Consequently, this difference should be factored 

in when making comparisons of the performance with other signal types. 
ILLUSTRATIVE PR! LEM 





Mlustrative Problem 5.6 Use Monte Carlo simulation to estimate and plot the performance 
of a binary communication system employing on-off signaling. 


Exim» —_§ 


The model for the system to be simulated is similar to that shown in Figure 5.13, except 
that one of the signals is 0. Thus, we generate a sequence of random variables {r;} as given 
by (5.2.34). The detector compares the random variables {7;} to the optimum threshold £ /2 
and makes the appropriate decisions. Figure 5.16 illustrates the estimated error probability 
based on 10,000 binary digits. The theoretical error rate given by (5.2.39) is also illustrated 
in this figure. The MATLAB scripts for this problem are given below. 


aia» 











% MATLAB script for Mustrative Problem 6, Chapter $. 
echo on 
SNRindB1=0:1:1 
SNRindB2=0:0,1:15; 
for i=1dength(SNRindB1), 

smld_err.prb(i)=smldPeS6(SNRindBI(i)), F% simulated errr rate 





end; 

for i= :length(SNRindB2), 
SNR=exp(SNRindB2(i)+log(10)/10), % signal-to-noise ratio 
theo.err_prh(i)=Qfunct(sqr(SNR/2)};  % theoretical error rute 
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end; 

% plotting commands follow 
semilogy(SNRindB | smld_ert_prb,‘ * *); 
hold 
semilogy(SNRindB2,theo_err_prb); 


pom MILE 


function {p]=smldPe56{snr_in_4B) 
% {p} = smidPeS6{snrindB) 











% SMLDPES6 simulates the probability of error for a given 
% snrindB. signal-to-noise ratio in dB. 
Est; 
alpha_opc=1/2: 
SNR=exp(snr_in_dBelog(10)/10) % signal-to-noise -ratio 
sgma=E/sqm(2«SNR): % sigma, standard deviation of noise 
N=10000; 
% generation of the binary duta source follows 
for i=1:N, 
temp=rand: % u uniform random variable over (0,1) 
if (emp<0.5), 
dsource(i)=0; % with probability 1/2, source output is O 
else 
dsource(i)=1; % with probability 1/2, source output is 1 
end 
end: 
% detection, and probability of error calculation 
aumoferr=0; 
for i=1:N, 





% The matched filter outputs 
if (dsource(i==0), 


r=gngauss(sgma); % if the source mutput is “O” 
else 

r=E+gngauss(sgma): % if the source output is “I” 
end; 


% detector follows 
if (¢<alpha_opt), 


decis=0; % decision is “0” 
else 
decis=1; % decision is “I” 
end: 
if (decis"=dsource(i)), % af it is un error increase the error counter 
numoferr=numoferr+1: 
end; 
end: 
p=numoferr/N; % probability of error estimate 





5.2.9 Signal Constellation Diagrams for Binary Signals 


The three types of binary signals, namely, antipodal, on-off, and orthogonal, may be char- 
acterized geometrically as points in “signal space.” In the case of antipodal signals, where 


186 CHAPTER 5. BASEBAND DIGITAL TRANSMISSION 

















10 logig £/No 


Figure 5.16: Error probability from Monte Carlo simulation compared with theoretical 
error probability for on-off signals. 


the signals are s(t) and —s(r)}, each having energy £. the two signal points fall on the real 
line at +VE, as shown in Figure 5.17(a). The one-dimensional geometric representation 
of antipodal signals follows from the fact that only one signal waveform or basis function, 
namely, s(t), suffices to represent the antipodal signals in the signal space. 

On-off signals are also one-dimensional. Hence, the two signal points also fall on the 
real line at 0 and YZ, as shown in Figure 5.17(b). 

On the other hand, binary orthogonal signals require a two-dimensional geometric rep- 
resentation, since there are two linearly independent functions so(t) and s; (1) that constitute 
the two signat waveforms. Consequently, the signal points corresponding to these points 
are (VE, 0) and (0, VE), as shown in Figure 5.17(c). 

The geometric representations of the binary signals shown in Figure 5.17 are called 
signal constellations. 


ILLUSTRATIVE PROBLEM. 


Illustrative Problem 5.7 The effect of noise on the performance of a binary communica- 
tion system can be observed from the received signal plus noise at the input to the detector. 
For example, let us consider binary orthogonal signals, for which the input to the detector 
consists of the pair of random variables (ro. r;), where either 





Cori) = (WE + noni) 


or 


Cori) = (no, VE +m) 
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The noise random variables ng and 1, are zero-mean, independent Gaussian random vari- 
ables with variance o?. As in Illustrative Problem 5.4, use Monte Carlo simulation to 
generate 100 samples of (ro, rı) for each value of o = 0.1,0 = 0.3, ando = 0.5, and 
plot these 100 samples for each o on different two-dimensional plots. The energy £ of the 
signal may be normalized to unity. 


Eri 


‘The results of the Monte Carlo simulation are shown in Figure 5.18. Note that at a 
low noise power level (ø small) the effect of the noise on performance (error rate) of the 
communication system is small. As the noise power level increases, the noise components 
increase in size and cause more errors 








JE 

oe oo - all + 

-JE 0 VE 0 VE lo VE 
(a) (b) (c) 


Figure 5.17: Signal point constellation for binary signals. (a) Antipodal signals. (b) On-off 
signals. (c) Orthogonal signals. 


The MATLAB script for this problem for e = 0.5 is given below. 








% MATLAB script for Ilustrated Problem 7, Chapter $. 
echo on 

nO=random( ‘norm’ ,0,0.5.100.1); 

nl=random(’ norm’ .0.0.5,100.1); 

n2=random( ‘norm’ 5,100.1); 

n3=random( ‘norm’ ,0,0.5,100,1): 












yt=t.4n3; 
plow(xLyl."o°x2.y2.°"+) 
axis(‘ square’) 





5.3 Multiamplitude Signal Transmission 


In the preceding section, we treated the transmission of digital information by use of binary 
signal waveforms. Thus, each signal waveform conveyed 1 bit of information. In this 
section, we use signal waveforms that take on multiple amplitude levels. Thus, we can 
transmit multiple bits per signal waveform. 
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Figure 5.18: Received signal points at input to the selector for orthogonal signals (Monte 
Carlo simulation). 
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5.3.1 Signal Waveforms with Four Amplitude Levels 


Let us consider a set of signal waveforms of the form 


Sm(t) = Amat), Ost<T (5.3.1) 
where Am is the amplitude of the mth waveform and g(t) is a rectangular pulse defined as 


JWT, O<t<T 


sts 0, otherwise 


(5.3.2) 


where the energy in the pulse g(t) is normalized to unity. In particular, we consider the case 
in which the signal amplitude takes on one of four possible equally spaced values—namely, 
{Am} = {—3d, ~d, d, 3d} or, equivalently, 


Am =(2m~3)d,  m=0,1,2,3 (5.3.3) 


where 2d is the Euclidean distance between two adjacent amplitude levels. The four signal 
waveforms are illustrated in Figure 5.19. We call this set of waveforms pulse amplitude 
modulated (PAM) signals. 

The four PAM signal waveforms shown in Figure 5.19 can be used to transmit 2 bits of 
information per waveform. Thus, we assign the following pairs of information bits to the 
four signal waveforms: 


00 — soli) 
Ol > s;{t) 
11 — s2(t) 
10 > s3(t) 


Each pair of information bits (00, 01, 10, 11} is called a symbol, and the time duration T 
is called the symbol interval. Note that if the bit rate is R = 1/Te, the symbol interval is 
T = 2T,. Since all the signal waveforms are scaled versions of the signal basis function 
g(t), theses signal waveforms may be represented geometrically as points on the real line. 
Therefore, the geometric representation of the four PAM signals is the signal constellation 
diagram shown in Figure 5.20. 

As in the case of binary signals, we assume that the PAM signal waveforms are trans- 
mitted through an AWGN channel. Consequently, the received signal is represented as 


r(t) = si (t) + n(Y; i =0,1,2,3, 0st <T (5.3.4) 


where n(t) is asample function of a white Gaussian noise process with power spectrum No/2 
watts/hertz. The task of the receiver is to determine which of the four signal waveforms 
was transmitted after observing the received signal r(t) in the interval 0 < t < T. The 
optimum receiver is designed to minimize the probability of a symbol error. 
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Figure 5.19: Multiamplitude signal waveforms. 
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Figure 5.20; Signal constellation for the four-PAM signal waveforms. 
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5.3.2 Optimum Receiver for the AWGN Channel 


The receiver that minimizes the probability of error is implemented by passing the signal 
through a signal correlator or matched filter followed by an amplitude detector. Since the 
signal correlator and the matched filter yield the same output at the sampling instant, we 
consider only the signal correlator in our treatment. 


5.3.3 Signal Correlator 


The signal correlator cross-correlates the received signal r(t) with the signal pulse g(r) and 
its output is sampled at = T. Thus, the signal correlator output is 


f 
=f r(t)g(t) dr 
0 


y T 
-f Agodi | g(t)n(t) dt 
0 0 
= Ai +n (5.3.5) 


where n represents the noise component, defined as 


r 
"=f g(t)n(t) dr (5.3.6) 
o 


We note that n is a Gaussian random variable with mean 


T 
E(n) =f a(tyE[a(n] dt = 0 (5.3.7) 
0 
and variance 
a? = E(n?) 
T pT 
=f f B(t)e(r)E [n(t)n(t)} dt dr 


T pT 
-7f [ a(tha(t)o(t ~ ct) dtdr 


lf 
lg 
oom 
3 
oy, 
t 
= 


= (5.3.8) 


Therefore, the probability density function for the output r of the signal correlator is 
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ptr | s;(t)was transmitted) = eTA 7/20 (5.3.9) 





where A; is one of the four possible amplitude values. 


5.3.4 The Detector 


The detector observes the correlator output r and decides which of the four PAM signals was 
transmitted in the signal interval. {n the following development of the performance of the 
optimum detector, we assume that the four possible amplitude levels are equally probable. 

Since the received signal amplitude A; can take the values + d, + 3d. as illustrated in the 
signal constellation in Figure 5.20, the optimum amplitude detector compares the correlator 
output z with the four possible transmitted amplitude levels and selects the amplitude level 
that is closest in Euclidean distance to r. Thus, the optimum amplitude detector computes 
the distances 


Di = |r - Ail. i=0,1,2,3 (5.3.10) 


and selects the amplitude corresponding to the smallest distance. 

We note that a decision error occurs when the noise variable exceeds in magnitude 
one-half of the distance between amplitude levels, i.e., when jn| > d. However, when 
the amplitude levels +3d or —3d are transmitted, an error can occur in one direction only. 
Since the four amplitude levels are equally probable, the average probability of a symbol 
error is 


3 
Py= qh Anl >d) 


Fi Lyne jy 
=> —— da 
2ja [no 
L ae E 
=> e" 7 dx 
2 Jaj Sn 
3 d? 
=z eya 
3 2d? 
=i = 5.3.11 
5 No (5.3.11) 


We observe that the squared distance between successive amplitude levels is (2d)? = 8°. 
Therefore, the average probability of error may be expressed as 
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e 
\ 4No 





P= žo (5.3.12) 


Alternatively, the average probability of error may be expressed in terms of the signal energy. 
Since all four amplitude levels are equally probable, the average transmitted signal energy 
per symbol is 


ney ae 2 
f=] sp(t)dt = Sd (5.3.13) 


Consequently, d? = E,y/5 and, hence, 


3 f [2k 
P= 30( ie ) (5.3.14) 


Since each transmitted symbol consists of two information bits, the transmitted average 
energy per bit is £yy/2 = Eavb. 

The average probability of error Py is plotied in Figure 5.21 as a function of the SNR 
defined as 10 log i9(Zays/No). 








ILLUSTRATIVE PROBLEM 


IMustrative Problem 5.8 Perform a Monte Carlo simutation of the four-level (quaternary) 
PAM communication system that employs a signal cortelator, as described above, followed 
by an amplitude detector. The model for the system to be simulated is shown in Figure 5.22. 


Ei — 


As shown, we simulate the generation of the random variable r, which is the output of 
the signal correlator and the input to the detector. We begin by generating a sequence of 
quaternary symbols that are mapped into corresponding amplitude levels {Am}. To accom- 
plish this task, we use a random number generator that generates a uniform random number 
in the range (0, 1). This range is subdivided into four equal intervals, (0, 0.25), (0.25, 0.5), 
(0.5, 0.75), (0.75, 1.0), where the subintervals correspond to the symbols (pairs of infor- 
mation bits) 00, OL, 11, 10, respectively. Thus, the output of the uniform random number 
generator is mapped into the corresponding signal amplitude levels (-3d, —d, d, 3d), te- 
spectively. 

The additive noise component having mean 0 and variance o is generated by means 
of a Gaussian random number generator. For convenience, we may normalize the distance 
parameter d = | and vary oa. The detector observes 7 = Am +n and computes the distance 
between r and the four possible transmitted signal amplitudes. Its output Am is the signal 
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Figure 5.21: Probability of symbol error for four-level PAM. 


amplitude level corresponding to the smallest distance. A,, is compared with the actual 
transmitted signal amplitude, and an error counter is used to count the errors made by the 
detector. 

Figure 5.23 illustrates the results of the simulation for the transmissions of N=10,000 
symbols at different values of the average bit SNR, which is defined as 


2 
Ew 3 (5) (5.3.15) 


Note the agreement between the simulation results and the theoretical values of P4 computed 
from (5.3.14). The MATLAB scripts for this problem are given below. 














% MATLAB script for Ilustrated Problem 8, Chapter 5. 





12; 
for i=t:length(SNRindB |), 
% simulated error rate 
smld_err.prb(ij=smldPeS7(SNRindB I(i)); 
end; 
for i=1:length(SNRindB2), 
% signal-to-noise ratio 
SNR_per_bit=exp(SNRindB2(i)slog(10)/10); 





pma 
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Figure 5.22: Block diagram of four-level PAM for Monte Carlo simulation. 


% theoretical error rate 
theo_err_prbi}=(3/2)«Qfunct(sqn((4/5)«SNR_per.bit)); 

end; 

% plotting commands follow 

semilogy(SNRindB | smid_err_prd,'* "); 

hold 

semilogy(SNRindB2,theo-err_prb}; 


ara» — 


function [p}=smldPe57(snz_in_dB) 
% tp} = smidPeS7(snr_in-dB} 











% SMLDPES7 simulates the probability of error for the given 
% snr.indB, signal-to-noise ratio in dB. 
d=1; 


SNR=exp(snr-in-dB+iog(10)/10); 
sgma=sqrt((Sed”2)/(4"SNR)); 


% signal-to-noise ratio per bit 
% sigma, standard deviation of noise 


N=10000; % number of symbols being simulated 
% generation of the quarternary data source follows 
for i=1:N, 
temp=rand; % a uniform random variable over (0,1) 
if (temp<0.25), 
dsourcei)=0; % with probability 1/4, source output is “00” 
elseif (temp<0.5), 
dsource(i)=1; % with probability 1/4, source output is “Ol” 
elseif (temp<0.75), 
dsource(i)=2; % with probability 1/4, source output is “10” 
else 
dsource(i)=3; % with probability 1/4, source output is “11” 
end 
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end; 

% detection, and probability of error calculation 

numoferr=0, 

for i=1:N, 


% The mutched filter outputs 
if (dsource(ij==0), 


r=—3«d+pngauss(sgma); % if the source output is “00” 
elseif (dsource{ij==1), 
r=—d+gngauss(sgma); % if the source vutput is “Ol” 
elseif (dsource(i)==2) 
r=d+gngauss(sezna), % if the source vutpur is “10° 
else 
r=3*d+gngauss(sema); % if the source output is “LE” 
end: 
% detector follows 
if (r<~2*d), 
decis=0; % decision is “OO" 
elseif (r<0), 
decis=1; % decision is “OL” 
elseif (r<2*d), 
decis=2, % decision ts “10” 
else 
decis=3; % decision ts “HL” 
end, 
if (decis”=dsource(i)), % if it is an error, increase the error counter 
numoferr=numofer +1; 
end; 
end; 
p=numoferr/N; % probability of error estimate 


a 








5.3.5 Signal Waveforms with Multiple Amplitude Levels 


It is relatively straightforward to construct multiamplitude signals with more than four 
levels. In general, a set of M = 2* multiamplitude signal waveforms is represented as 


Sm{t) = Amat), O<:<T, m= 0,1,2,..., M — i 


where the M amplitude values are equally spaced and given as 


Am = (2m —-M+1)d, m=0,1,...,M-1 (5.3.16) 


and g(t) is a rectangular pulse, which has been defined in (5.3.2), Each signal waveform 
conveys k = log, M bits of information. When the bit rate is R = 1/Tp, the corresponding 
symbol rate is 1/7 = 1/kTy. As in the case of four-level PAM, the optimum receiver 
consists of a signal correlator (or matched ftiter) followed by an amplitude detector that 
computes the Euclidean distances given by (5.3.10) form =0,1,..., M — 1. For equally 
probable amplitude levels, the decision is made in favor of the amplitude level that corre- 
sponds to the smallest distance. 
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Figure 5.23: Error probability for Monte Carlo simujation compared with theoretical error 
probability for M = 4 PAM. 


The probability of error for the optimum detector in an M-level PAM system is easily 


shown to be 
_ XM - 1) (log M)Eavk 
Py = a Q ( DN —DNo (5.3.17) 


where £ay, is the average energy for an information bit. Figure 5.24 illustrates the proba- 
bility of a symbol error for M = 2, 4, 8, 16. 
ILLUSTRATIVE PROBLEM 





Tilustrative Problem 5.9 Perform a Monte Carlo simulation of a 16-level PAM digital 
communication system and measure its error-rate performance. 





The basic block diagram shown in Figure 5.22 applies in general. A uniform random 
number generator is used to generate the sequence of information symbols, which are 
viewed as blocks of four information bits. The 16-ary symbols may be generated directly 
by subdividing the interval (0, 1) into 16 equal-width subintervals and mapping the 16-ary 
symbols into the 16-ary signal amplitudes. A white Gaussian noise sequence is added 
to the 16-ary information symbol sequence, and the resulting signal plus noise is fed to 
the detector, The detector computes the distance metrics given by (5.3.10) and selects the 
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Figure 5.24: Symbol error probability for M-level PAM for. M = 2, 4, 8, 16. 


amplitude corresponding to the smallest metric. The output of the detector is compared with 
the transmitted information symbol sequence and errors and counted. Figure 5.25 illustrates 
the measured symbol error rate for 10,000 transmitted symbols and the theoretical symbol 
error rate given by (5.3.17) with M = 16. The MATLAB scripts for this problem are given 


below. 


eae 





% MATLAB script for Illustrative Problem 9, Chapter 5. 





echo on 
SNRindB1=5:1:25; 
SNRindB2=5:0,1:25; 
M=16; 


for i=1:Jlength(SNRindB1), 
% simulated error rate 
smid.err_prd(i)=smldPe58(SNRindB 1(i)); 
end; 
for i=1:length(SNRindB2), 


SNR-per_bit=exp(SNRindB2(i)+log(10)/10); 


% theoretical error rate 


theo.err_prb(i)=(2*(M~ 1)/M)*Qfunct(sqrt((6*log2(M)/(M* 2—1))*SNR.per_bit)); 


end; 

% plotting commands follow 
semilogy(SNRindB1 smmld_err_prb,’ * “ ); 
hold 

semilogy(SNRindB2,theo_err_prb); 





5.3. Multiamplitude Signal Transmission 


em 
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function [p]=smldPeS8(snr_in_dB) 
% {p} = smldPeS8(snrin dB) 
% SMLDPESB simulates the error probability for the given 


% snrindB, signal-to-noise ratio in dB. 
M=16; % 16-ury PAM 
d=1; 


SNR=exp(snr_in-dB-*log(10)/ 10), 
sgma=sqrt((85+d*2)/(8*SNR)); 


% signal-to-noise ratio per bit 
% sigma, standard deviation of noise 


N=10000,; % number of symbols being simulated 

% generation nf the quarternary data source 

for i=1:N, 
temp=rand; % a uniform random variable over (0,1) 
index=Roor(Mstemp), % the index is an integer from O w M-i, where 


% all the possible values are equally likely 
dsource(i)=index; 

end; 

% detection, und probability of error culculation 





% matched filter outputs 

% (2edsource(i)-M+I}ad is the mapping to the 16-ary constellation 

r=(2edsource(i)—M+1)+d+gngauss(sgma); 

Go the detector 

if (¢>(M~2)«d), 
decis=15; 

elseif (r>(M—4)=d), 
decis=14; 

elseif (r>{M—6)+d), 
decis=13; 

elseif (r>(M-8)«d), 
decis=12; 

elseif (r>(M—10)=d), 
deci : 

elseif (r>(M—12)«d), 
decis=10; 

elseif (r>(M--14)«d), 
decis=9; 

elseif (r>(M—16)«d), 
decis=8; 

elseif (r>(M—18)+d), 
decis=7; 

elseif (r>(M~20)xd), 
decis=6; 

elseif (r>(M—22)xd), 
decis=5; 

elseif (t>(M—24)«d), 
decis=4; 

elseif (t>(M-26)xd), 
decis=3; 

eiseif (r>(M—28)+d), 
decis=2; 

elseif (r>(M-30)+d), 
decis=1; 

else 
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decis=0; 
end; 
if (decis"=dsource(i)), % if ir is an error, increase the error counter 
numoferr=numofesr+1: 
end; 
end: 
psnumoferr/N: % probability of error estimate 
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Figure 5.25: Error rate from Monte Carlo simulation compared with the theoretical error 
probability for M = t6 PAM. 


5.4 Multidimensional Signals 


In the preceding section we constructed multiamplitude signal waveforms, which allowed 
us to transmit multiple bits per signal waveform. Thus, with signal waveforms having 
M = 2* amplitude levels, we are able to transmit k = log, M bits of information per 
signal waveform. We also observed that the multiamplitude signals can be represented 
geometrically as signal points on the real line (see Figure 5.20). Such signal waveforms 
are called one-dimensional signals. 

In this section we consider the construction of a class of M = 2 signal waveforms 
that have a multidimensional representation. That is, the set of signal waveforms can be 
represented geometrically as points in N-dimensional space. We have already observed 
that binary orthogonal signals are represented geometrically as points in two-dimensional 
space. 


5.4. Multidimensional Signals 201 


5.4.1 Multidimensional Orthogonal Signals 


There are many ways to construct multidimensional signal waveforms with various proper- 
ties. In this section, we consider the construction of a set of M = 2* waveforms 5;(t), for 
i =0,1,..., M — 1, which have the properties of (a) mutual orthogonality and (b) equal 
energy. These two properties may be succinctly expressed as 


r5 
[ Si(t)sa (hat = Ediz, i,k=0,1,...,M@—-1 (5.4.1) 
0 


where & is the energy of each signal waveform and ôig is called the Kronecker delta, which 
is defined as 


l, isk 
n=l igk (5.4.2) 


As in our previous discussion, we assume that an information source is providing a 
sequence of information bits, which are to be transmitted through a communication channel. 
The information bits occur at a uniform rate of R bits per second. The reciprocal of R is 
the bit interval, Tp. The modulator takes k bits at a time and maps them into one of M = 2 
signal waveforms. Each block of & bits is called a symbol. The time interval available to 
transmit each symbol is T = kTp. Hence, T is the symbol interval. 
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Figure 5.26: An example of four orthogonal, equal-energy signal waveforms. 


The simplest way to construct a set of M = 2* equal-energy orthogonal waveforms in 
the interval (0, T) is to subdivide the interval into M equal subintervals of duration T/M and 
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to assign a signal waveform for each subinterval. Figure 5.26 illustrates such a construction 


for M = 4 signals. All signa! waveforms constructed in this manner have identical ener, A 
S g 
given as 


ta 
z=f sdt,  i=0,1,2,...,M—1 
0 


=A°T/M (5.4.3) 


Such a set of orthogonal waveforms can be represented as a set of M-dimensional orthogonal 
vectors, i.e., 


so = (VE,0.0,...,0) 
sı = (0, VE,0,... ,0) 


sm = (0,0,...,0, VE) (5.4.4) 


Figure 5.27 illustrates the signal points (signal constellations) corresponding to M = 2 and 
M = 3 orthogonal signals. 





Figure 5.27: Signal constellation for M = 2 and M = 3 orthogonal signals. 


Let us assume that these orthogonal signal waveforms are used to transmit information 
through an AWGN channel. Consequently, if the transmitted waveform is s; (t), the received 
waveform is 


r(t) = s(t) + n(t), O<:<T, i=01,...,.M—1 (5.4.5) 


where n(t) is a sample function of a white Gaussian noise process with power spectrum 
No/2 watts/hertz. The receiver observes the signal r(t) and decides which of the M signal 
waveforms was transmitted, 
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Optimum Receiver for the AWGN Channel 


The receiver that minimizes the probability of error first passes the signal r(t) through 
a parallel bank of M matched filters or M correlators. Since the signal correlators and 
matched filters yield the same output at the sampling instant, let us consider the case in 
which signal correlators are used, as shown in Figure 5.28. 
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Figure 5.28: Optimum receiver for multidimensional orthogonal signals, 


Signal Correlators 


The received signal 7 (t) is cross-correleted with each of the M signal waveforms and the 
correlator outputs are sampled att = T. Thus, the M correlator Outputs are 


T 
rj -f r(t)s;(t) de, i=0,1,...,M —1 (5.4.6) 
0 


which may be represented in vector form as r = [ro, la PTA rmz]. Suppose that signal 
waveform so(t) is transmitted. Then, 


T T 
r= f dinars f n(t)so(t) dt 
0 o 
=E +n (5.4.7) 
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and 
T T 
ri =f sioninar + f n(t)si(t) dt 
0 0 
T 
=f n(t)sj{t) dt = ni, 6=1,2,3,...,.M—1 (5.4.8) 
0 
where 
T 
ni =| n(t)s;(t) at (5.4.9) 
o 


Therefore, the output ro consists of a signal component £ and a noise component ng. The 
other M — 1 outputs consist of noise only. Each of the noise components is Gaussian, with 
mean zero and variance 


oes E(n?) 


T pT 
f [ S(OS (TIE [n(t)n(t)) dt dt 
a Jo 


ToT 
=f f silt)si (t) — tr) dtdt 
2 Jo Jo 


No f7 
=f sa) dt 


Not 
2 


(5.4.10) 


The reader is encouraged to show that E{njnj) = 0,i # j. Consequently, the proba- 
bility density functions for the correlator outputs are 





P(ro | so{t) was transmitted) = en o- EY ro? 
No 
3 
(ri | solt) was transmitted) = ———e"/?" GH 1,2,...,M—1 
ving 
The Detector 
The optimum detector observes the M correlator outputs rj,i = 0, 1,..., M — t and 


selects the signal corresponding to the largest correlator output. In the case where so(t) was 
transmitted, the probability of a correct decision is simply the probability that ro > r; for 
i=1,2,...,M—l,ie, 


Pe = P(ro > riro > r2... 70 >TM) (5.4.11) 
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and the probability of a symbol error is simply 


Py =l- P: 
=i = P(ro > riro > Tz... To > TM=) (5.4.12) 


It can be shown that Py can be expressed in integral form as 


oo é 
Py = 5f (1-11 = QOM Jent- dy (5.4.13) 
-o0 


For the special case M = 2, the expression in (5.4.13) reduces to 


Pa = o (VETM) 


which is the result we obtained in Section 5.2 for binary orthogonal signals. 

The same expression for the probability of error is obtained when any one of the other 
M — | signals is transmitted. Since all the M signals are equally likely, the expression 
for Py given by (5.4.13) is the average probability of a symbol error. This integral can be 
evaluated numerically. 

Sometimes, it is desirable to convert the probability of a symbol error into an equivalent 
probability of a binary digit error. For equiprobable orthogonal signals, all symbol errors 
are equiprobable and occur with probability 


Pu Pu 


— == 4.14 
M-1 2-1 OF 


Furthermore, there are C) ways in which n bits out of k may be in error. Hence, the average 
number of bit errors per k-bit symbol is 


k\ P ake! 
ba j =k Pm (5.4.15) 


ant 
and the average bit error probability is just the result in (5.4.15) divided by k, the number 
of bits per symbol, Thus 


24-1 
Qk 





P, = Pu (5.4.16) 





‘The graphs of the probability of a binary digit error as a function of the SNR per bit, 
Ep/ No, are shown in Figure 5.29 for M = 2,4, 8, 16, 32,64, where £, = £ /k is the 
energy per bit. This figure illustrates that by increasing the number M of waveforms, one 
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Figure 5.29: Bit-error probability for orthogonal signals. 


can reduce the SNR per bit required to achieve a given probability of a bit error. The 
MATLAB script for the computation of the error probability in (5.4.13) is given below. 





% MATLAB script that generates the probability of error versus the signal-to-noise ratio 
initial-snr=0; 


% tolerance used for the integration 
% this is practically -infinity 
% this is practically infinity 








plus.in 
-dB=initial_snr:snr_step:final_snr: 
slength(sar_in-dB), 
snr=10"(snr_in-dB(i)/10); 
Pe_2(i)=Qfunct(sqrtisnr)); 
Pe_A(i)=(2/3)xquad8( ’ bdt_int ‘ minus-inf,plus_inf,tolerance,[ ],snr,4); 
Pe_8(i)=(4/7)«quad8(’ bdt int minus-inf,plus-inf.tolerance,{ ].snr.8); 
Pe_16(i)=(8/15)«quad8(“ bdt_int ’ ,minus-inf,plus-inf,tolerance,{ },snr, 16); 
Pe_32(i)=(16/31 )equad&(‘ bat int’ ,minus_inf.plus_inf.tolerance,{ },snr,32); 
Pe_64(i)=(32/63)xquad&( ‘bdt_int ‘ ,minus-inf,plus-inf,tolerance,{ },snr.64): 
end; 
% plotting commands follow 
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ILLUSTR, PROBLE! 


Mltustrative Problem 5.10 Perform a Monte Carlo simulation of a digitat communication 


system that employs M = 4 orthogonal signals. The model of the system to be simulated 
is illustrated in Figure 5.30. 
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Figure 5.30: Block diagram of system with M = 4 orthogonal signals for Monte Carlo 
simulation. 


em SOLUTION as 


As shown, we simulate the generation of the random variables ro, r1, r2, r3, which 
constitute the input to the detector. We may first generate a binary sequence of 0’s and 1’s 
that occur with equal probability and are mutually statistically independent, as in Illustrative 
Problem 5.4. The binary sequence is grouped into pairs of bits, which are mapped into the 
corresponding signal components. An alternative to generating the individual bits is to 
generate the.pairs of bits, as in Illustrative Problem 5.8. In any case, we have the mapping 
of the four symbols into the signal points: 
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00 — so = (VE,0,0, 0) 
Ol — sı = (0, VE, 0, 0) 
10 > sz = (0,0, VE, 0) 
11 > s = (0,0,0, VE} (5.4.17) 


The additive noise components no, m1,2,"3 are generated by means of four Gaussian 
noise generators, each having a mean zero and variance o? = Ny£ /2. For convenience, 
we may normalize the symbol energy to £ = 1 and vary o*. Since E = 2£p, it follows 
that £p = $. The detector output is compared with the transmitted sequence of bits, and 
an error counter is used to count the number of bit errors. 

Figure 5.31 illustrates the results of this simulation for the transmission of 20,000 bits 
at several different values of the SNR E»/No. Note the agreement between the simulation 
results and the theoretical value of Ph given by (5.4.16). The MATLAB scripts for this 
problem are given below. 








% MATLAB script for Mlustrative Problem 10, Chupter 5 
echo on 
SNRindB=0:2:10; 
for i=1:length(SNRindB), 
% simulated error rate 
smid-err_pro(i}=smldPe5%SNRindB(i)); 
end; 
% plotting commands follow 
semilogy(SNRindB,smld-ert_ptb.’*"); 


~~“ 


function (p}=smnldPe59{snr_in.dB) 

% {p} = smidPe5%snr_in-dB) 

% SMLDPES9 simulates the probability of error for the given 
% snrindB, signal-to-noise ratio in dB. 

’ % quarternary orthogonal signalling 














SNR=exp(snrin.dBalog(10)/10); % signal-to-noise ratio per bit 
sgma=sqrt(E*2/(4xSNR)): % sigma, standard deviation of noise 
N=10000; % number of symbols being simulated 
% generation of the quurternury data source 
for i=1:N, 

temp=rand; % a uniform random variable over (0.1) 


if (temp<0.25), 
dsource(i)=0; 
dsource2(i)=0; 

elseif (temp<0.5), 
dsource)(i)=0; 
dsource2(i)=1; 

elseif (temp<0.75), 








i 
| 
j 
i 
{ 
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dsourcel(i)=1; 
dsource2(i)=0; 
else 
dsourcei{i)=1; 
dsource2(}=1; 
end 
end: 
% detection, and probability of error calculation 
oumoferr=0; 
for i=1:N, 
% matched filter outpuis 
if ((dsourcel{i)==0) & (dsource2(i==0)), 
rO=sqrt(E)+gngauss(sgma), 
rl=gngauss(sgma); 
r2=gngauss(sgma); 
s3=gngauss(sgma): 
elseif ((dsource {i)==0) & (dsource2(i)==1)), 
r0=gngauss(sgma), 
rl=sqr(E)+gngauss(sgma); 
r2=gngauss(sgma); 
r3=gngauss(sgma), 
elseif ((dsource (i)==1) & (dsource2(i 
rO=gngauss(sgma); 
gauss(sgma); 








sqrt(E)+gngauss(sgina), 
r=gngauss(sgma); 

else 
rO=gngauss(sgma); 





rJ=sqr(E)+gngauss(sgma); 
end; 

% the detector 
max_semax([r0 ri r2 3): 





% count the number of bit errors made in this decision 
if (decis1 
numoferr=numoferr +1; 








end; 
if (decis2“=dsource2(i)), % if it is an error, increase the error counter 
numoferr=numoferr +1; 
end; 
end; 
p=numoferr /(2+N); % bit error probability estimate 


<dsource |(i)}, % if if is an error, increase the error counter 
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Figure 5.31: Bit error probability for M = 4 orthogonal signals from a Monte Cario 
simulation compared with theoretical error probability. 


5.4.2 Biorthogonal Signals 


As we observed in the preceding section, a set of M = 2* equal-energy orthogonal wave- 
forms can be constructed by subdividing the symbol interval T into M equal subintervals 
of duration T/M and assigning a rectangular signal pulse to each subinterval. A similar 
method can be used to construct another set of M = 2* multidimensional signals that 
have the property of being biorthogonal. In such a signal set, one-half the waveforms are 
orthogonal and the other half are the negative of these orthogonal waveforms. That is, 
solt), s(t), ... , 5472-1 (t) are orthogonal signal waveforms. The other M/2 waveforms 
are simply si+m/2(t) = —s; (t), fori = 0, 1,... , M/2 — 1. Thus we obtain M signals, 
each having M/2 dimensions. 

The M/2 orthogonal waveforms can be easily constructed by subdividing the symbol 
interval T = kT, into M/2 nonoverlapping subintervals, each of duration 2T/M, and 
assigning a rectangular pulse to each subinterval. Figure 5.32 illustrates a set of M = 4 
biorthogonal waveforms constructed in this manner. The geometric representation of a set 
of M signals constructed in this manner is given by the following (M /2)-dimensional signal 
points: 
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so = (VE,0.0,... ,0) 
sı = (0, VE,0,...,0) 


sm-1 = (0,0.0,..., VE) 
sun = (-VE,0,0,... ,0) 


sm-1 = (0,0,...,-VE) (5.4.18) 
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Figure 5.32: A set of M = 4 biorthogonal signal waveforms. 
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As in the case of orthogonal signals, let us assume that the biorthogonal signal waveforms 
are used to transmit information through an AWGN channel. Then, the received signal 
waveform may be expressed as 


r(t) =s)(t) + a(t), O<'<T (5.4.19) 


where 5; {t} is the transmitted waveform and n(t) is a sample function of a white Gaussian 
noise process with power spectrum No/2 watts/hertz. 


Optimum Receiver 


The optimum receiver may be implemented by cross-correlating the received signal r(t) 
with each of the M/2 orthogonal signal waveforms, sampling the correlator outputs at 
t = T, and passing the M/2 correlator outputs to the detector. Thus, we have 


$ 
ri -f r(Ðs:()dt,  i=0,1,.., = = 1 (5.4.20) 
o 2 
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Suppose that the transmitted signal waveform is so(t). Then, 


F M 
n=f adi i=0,1,....—-1 
o 2 
=0 
= [z Ery ee (5.421) 
Nis i0 
where 
i M 
ni -f n(t)si(t) de, f=O1,....5-1 (5.4.22) 
0 2 


and £ is the symbol energy for each signal waveform. The noise components are zero-mean 
Gaussian and have a variance of o? = £ No/2 


The Detector 


The detector observes the M/2 correlator outputs (r;, O < i < M/2 — 1 } and selects the 
correlator output whose magnitude |r;| is largest. Suppose 


ir} = max {Iril} (5.4.23) 


Then, the detector selects the signal s;(t) ifr; > Oand —s;(r) ifr; < 0. 

To determine the probability of error, suppose that so(t) was transmitted. Then, the 
probability of a correct decision is equal to the probability that rọ = £ + 29 > 0 and 
rol > Ir, fori = 1,2,..., $ — 1. Thus, 


of p poB a ie 
P, -f f e™ P dx pro) dro (5.4.24) 
o uf VEN 





where 


er UE) a? (5.4.25) 





Finally, the probability of a symbol error is simply 
Py = 1 ~ P, (5.4.26) 


P, and Py may be evaluated numerically for different values of M from (5.4.24) and 
(5.4.25). The graph shown in Figure 5.33 illustrates Pa as a function of the signal-to-noise 
ratio £,/No, where E = k£, for M = 2,4, 8, 16, and 32. We observe that this graph 
is similar to that for orthogonal signals. However, for biorthogonal signals we note that 
P4 > Pz. This is due to the fact that we have plotted the symbol-error probability Pa in 
Figure 5.33. If we plot the equivalent bit-error probability, we would find that the graphs 
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Figure 5.33: Symbol-error probability for biorthogonal signals. 


for M = 2and M = 4 coincide. The MATLAB script for the computation of the error 
probability in (5.4.24) and (5.4.26) is given below. 








% MATLAB script that generates the probability of error versus the signal-to-noise ratio. 
initial_snr=0; 

final_snr=12; 

snr_step=0.75; 

tolerance=eps; % tolerance used for the integration 

% this is practically infinity 







‘initial_sne:sne_step:final_snr; 

length(snr-in-dB), 
snr=10^ (snr-in-dB(i)/ 10); 
Pe_2(i)=1—quad&(‘ bdt_int2 ‘,0,plus_inf,tolerance,{ ],snr.2}; 
Pe_4(i)=1—quad8(‘ bdt_int2 ’,0,plus_inf,tolerance,{ },snr.4), 
Pe_8(i)=1—quad8{ ' bdt_int 2’ .0,plus_inf,tolerance,{ ].snr.8); 
Pe_16(i)=1—quad8(‘ bat _int.2’.0,plus_inf.tolerance,[ ],snr,16); 
Pe_32(i}=1—quad8(‘ bdt_int2' ,0,plus.inf.tolerance,{ J.sar,32); 

end; 

% plotting commands follow 


See 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 5.1% Perform a Monte Carlo simulation for a digital communication 


system that employs M = 4 biorthogonal signals. The mode! of the system to be simulated 
is illustrated in Figure 5.34. 
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Figure 5.34: Block diagram of the system with M = 4 biorthogonal signals for Monte 
Carlo simulation. 


As shown, we simulate the generation of the random variables ro and z4, which constitute 
the input to the detector. We begin by generating a binary sequence of O's and I's that 
occur with equal probability and are mutually statistically independent, as in Illustrative 
Problem 5.4. The binary sequence is grouped into pairs of bits, which are mapped into the 
corresponding signal components as follows: 


00 — so = (VE, 0) 
Ol > sı =(0, VE) 
10 > s = (0, - VE) 
11 > s3 =(-VE,0) 


Alternatively, we may use the method in Illustrative Problem 5.8 to generate the 2-bit 
symbols directly. 

Since s2 = -sı and s3 = —so, the demodulation requires only two correlators or 
matched filters, whose outputs are ro and r). The additive noise components no and ny 
are generated by means of two Gaussian noise generators, each having a mean zero and 
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variance o? = No £ /2. For convenience, we may normalize the symbol energy to £ = 1 
and vary a°. Since £ = 2£,, it follows that E, =}. The detector output is compared 
with the transmitted sequence of bits, and an error counter is used to count the number of 
symbol errors and the number of bit errors. 

Figure 5.35 illustrates the results of this simulation for the transmission of 20,000 bits 
at several different values of the SNR £p/No. Note the agreement between the simulation 
results and the theoretical value of Py given by (5.4.26) and (5.4.24). The MATLAB scripts 
for this problem are given below. 





% MATLAB script for Hlustrative Problem 11, Chapter $. 
echo on 
SNRindB=0:2:10; 
for i=1:length(SNRindB), 
% simuluted error rate 
smld-err_prb(i)=smldP5 10(SNRindB()); 
end; 
% plotting commands follow 


e 


function [p}=smldP510(snr.in_dB) 
% [p] = smldPS10(snrin_dB) 
% SMLDPS10 simulates the probability of error for the given 











% snrindB, signal-to-noise ratio in dB, for the system 
To described in illustrated problem 10, Chapter 5. 
M=4, 


% quarternary orthogonal signalling 





E=3; 
SNR=expísnr-in-dB=log(10)/19); % signal to noise ratio per bit 
sgma=sqrn(E`2/(4aSNR)); % sigma, standard deviation of noise 
N=10000; % number of symbols being simulated 
% generation of the quarternary data source 
for N, 
temp=rand; % uniform random variable over (0,1) 
if (temp<0.25), 
dsource{i)=0; 
elseif (temp<0.5), 
dsource(i)=1; 
elseif (temp<0.75), 
dsource(i}=2; 
else 
dsource(i)=3; 
end 
end; 
% detection, and error probability computation 
numoferr=0; 
for i=1:N, 
% The matched filter outputs 
if (dsource(i)==0) 
r0=sqrt(E)+gngauss(sgma); 
rl=gngauss(sgma); 
elseif (dsource(i)==1) 
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rO=gngauss(sgma), 
si=sqrt(B)+gngauss(sgma), 
elseif (dsource(i)==2) 
=—sqrt(E)+gngauss(sgma); 
rl=gngauss(sgma); 
else 
rO=gngauss(sgma); 
tl=—sqr(E)+gngauss(sgma); 
end; 
% detector follows 
if (rO>abs(rl)), 








decis=0; 
elseif (r! >abs(r0)), 
decis=1; 
elseif (r0<—abs(e!)), 
decis=2; 
else 
decis=3; 
end; 
if (decis"=dsource(i)), % if it is an error, increase to the error counier 
numoferr=numoferr+1; 
end; 
end; 
penumoferr/N; % bit error probability estimate 
w 
Py 











10 logig (Z4/No) 


Figure 5.35: Symbol-error probability for M = 4 biorthogonal signals from Monte Carlo 
simulation compared with theoretical error probability. 
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Problems 


5.1 Suppose the two orthogonal signals shown in Figure 5.2 are used to transmit binary 
information through an AWGN channel. The received signal in each bit interval of duration 
Tp is given by (5.2.1). Suppose that the received signal waveform is sampled at a rate of 
10/7},, i.e., at 10 samples per bit interval. Hence, in discrete time, the signal waveform 
So(t) with amplitude A is represented by the 10 samples (A, A,..., A) and the signal 
waveform sı (f) is represented by the 10 samples (A, A, A, A, A, ~A, —A, —A, —A, —A). 
Consequently, the sampled version of the received sequence when so{t) is transmitted is 


rm=A+tn, k=1,2,...,10 


and when s; (£) is transmitted is 


where the sequence {7,} is i.i.d., zero-mean, Gaussian with each random variable having 
the variance c?. Write a MATLAB routine that generates the sequence {rz} for each of the 
two possible received signals and perform a discrete-time correlation of the sequence {7, } 
with each of the two possible signals so(#) and sı (4) represented by their sampled versions 
for different values of the additive Gaussian noise variance o? = 0, g? = 0.1, 07 = 1.0 
and a? = 2.0. The signal amplitude may be normalized to A = 1. Plot the correlator 
outputs at time instants k = 1,2,3,..., 10. 


5.2 Repeat Problem 5.1 for the two signal waveforms so(t) and s(t) illustrated in Figure 
P5.2. Describe the similarities and differences between this set of two signals and those 
illustrated in Figure 5.2. Is one set better than the other from the viewpoint of transmitting 
a sequence of binary information signals? 


sd) 50 
A 
T 
0 ‘ oy fer 
-A -A 
Figure P5.2 
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5.3 In this problem, the objective is to substitute two matched filters in place of the two 
correlators in Problem 5.1. The condition for generating signals is identical to Problem 5.1. 

Write a MATLAB routine that generates the sequence {rg} for each of the two possible 
received signals and perform the discrete-time matched filtering of the sequence {r;} with 
each of the two possible signals so(r) and sı (+), represented by their sampled versions, for 





different values of the additive Gaussian noise variance o? = 0, o? = 0.1, c? = 1.0, and 
= 2.0. The signal amplitude may be normalized to A = |. Plot the correlator outputs 
at time instants corresponding to k = 1,2,..., 10. 


5.4 Repeat Problem 5.3 for the signal waveforms shown in Figure P5.2. 


5.5 Run the MATLAB program that performs a Monte Carlo simulation of the binary 
communication system shown in Figure 5.8, based on orthogonal signals. Perform the 
simulation for 10,000 bits and measure the error probability fora ? = 0,02 = 0.1,g? = 1.0, 
and a? = 2.0. Plot the theoretical error rate and the error rate measured from the Monte 
Carlo simulation and compare the two results. Also plot 1000 received signal-plus-noise 
samples at the input to the detector for each value of a2. 


5.6 Repeat Problem 5.5 for the binary communication system shown in Figure 5.13 based 
on antipodal signals. 


5.7 Repeat Problem 5.5 for the binary communication system based on on-off signals. 


5.8 Run the MATLAB program that performs a Monte Carlo simulation of a quaternary 
PAM communication system. Perform the simulation for 10,000 symbols (20,000 bits) and 
measure the symbol-error probability for a? = 0, 02 = 0.1, o? = 1.0, anda? = 2.0, 
Plot the theoretical error rate and the error measured from the Monte Carlo simulation and 
compare these results. Also plot 000 received signal-plus-noise samples at the input to the 
detector for each value of o2. 


5.9 Modify the MATLAB program in Problem 5.8 to simulate M = 8 PAM signals and 
perform the Monte Carlo simulations as specified in Problem 5.8. 


5.10 Run the MATLAB program that performs the Monte Carlo simulation of a digital 
communication system that employs M = 4 orthogonal signals, as described in Illustrative 
Problem 5.10. Perform the simulation for 10,000 symbols (20,000 bits) and measure the 
bit-error probability for o? = 0.1, @? = 1.0, and ø? = 2.0. Plot the theoretical error 
probability and the error rate measured from the Monte Carlo simulation and compare 
these results, 


5.11 Consider the four signal waveforms shown in Figure P5.11. Show that these four 
signal waveforms are mutually orthogonal. Will the results of the Monte Carlo simulation 
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of Problem 10 apply to these signals? Why? 
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Figure P5.11 














5.12 Run the MATLAB program that performs the Monte Carlo simulation of a digital 
communication system thatemploys M = 4 biorthogonat signals, as described in Illustrative 
Problem 5.11. Perform the simulations for 10,000 symbols (20,000 bits) and measure the 
symbol error probability for 7? = 0.1, ¢? = 1.0, and o? = 2.0. Plot the theoretical 
symbol-error probability and the error rate measured from the Monte Carlo simulation, and 
compare the results. Aiso plot 1000 received signal-plus-noise samples at the input to the 
detector for each value of 7. 





3.13 Consider the four signal waveforms shown in Figure P5.13. Show that they are 
biorthogonal. Will the results of the Monte Carlo simulation in Problem 5. 12 apply to this 
set of four signal waveforms? Why? 
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Figure P5.13 





Chapter 6 


Digital Transmission Through 
Bandlimited Channels 


6.1 Preview 


In this chapter we treat several aspects of digital transmission through bandwidth-limited 
channels. We begin by describing the spectral characteristics of PAM signals. Secondly, 
we consider the characterization of bandlimited channels and the problem of designing 
signal waveforms for such channels. Then, we treat the problem of designing channel 
equalizers that compensate for distortion caused by bandtimited channels. We show that 
channel distortion results in intersymbol interference (ISI), which causes errors in signal 
demodulation. A channel equalizer is a device that reduces the intersymbot interference 
and thus reduces the error rate in the demodulated data sequence. 


6.2 The Power Spectrum of a Digital PAM Signal 


In the preceding chapter we considered the transmission of digital information by pulse 
amplitude modulation (PAM). In this section, we study the spectral characteristics of such 
signals. 

A digital PAM signal at the input to a communication channel is generally represented 
as 


% 
vt) = J> agtt -nT) (6.2.1) 

n=- 
where {an} is the sequence of amplitudes corresponding to the information symbols from 
the source, g(t) is a pulse waveform, and T is the reciprocal of the symbol rate. T is also 


called the symbol interval. Each element of the sequence {an} is selected from one of the 
possible amplitude values, which are 
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Am = (2m —-M-+1)d, © m=0,1,..., M-i (6.2.2) 


where d is a scale factor that determines the Euclidean distance between any pair of signal 

amplitudes (2d is the Euctidean distance between any adjacent signal amplitude levels). 
Since the information sequence is a random sequence, the sequence {a,} of amplitudes 

corresponding to the information symbols from the source is also random. Consequently, 

the PAM signal v(t) is a sample function of a random process V(t). To determine the 

spectral characteristics of the random process V(t), we must evaluate the power spectrum. 
First, we note that the mean value of V(t) is 


œ 
EIV = So Elane nT) (6.2.3) 
n=—0o 
By selecting the signal amplitudes to be symmetric about zero, as given in (6.2.2), and 
equally probable, E(a,) = 0, and hence E[{V(t)] = 0. 
The autocorrelation function of V (t) is 





Ry +r = EVV +r) (6.2.4) 


It is shown in many standard texts on digital communications that the autocorrelation func- 
tion is a periodic function in the variable t with period T. Random processes that have a 
periodic mean value and a periodic autocorrelation function are called periodically station- 
ary, or cyclostationary . The time variable 1 can be eliminated by averaging R,(t + T; t) 
over a single period, i.e., 


F 1 pT? 
R(t) = zÍ a Rolt +r; i)di (6.2.5) 
-T, 


This average autocorrelation function for the PAM signal can be expressed as 


= EE s 
Ros y PO Ralm)Re(t — mT) (6.2.6) 


m=~co 


where Ry(m) = E (dn@n+m) is the autocorrelation of the sequence {an and Re(t) is defined 
as 


3 
RO= f” eOe (62.7) 
a 


The power spectrum of V(t) is simply the Fourier transform of the average autocorre- 
lation function R,(r), i.e., 
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s= f Èe di 


æ 


L 2 
i FSG (6.2.8) 


where S4( f) is the power spectrum of amplitude sequence {an} and G(f) is the Fourier 
transform of the pulse g(r). S4{ f) is defined as 


æ 
Sul f) = SD Raimi (6.2.9) 


m=- 


From (6.2.8) we observe that the power spectrum of the PAM signal is a function of the 
power spectrum of the information symbols {a,} and the spectrum of the pulse g(r). In the 
special case where the sequence {an} is uncorrelated, i.e., 


o, m=0 
Rulm) = f e = 
(mn) 0, me0 (6.2.10) 
where o? = E (aż), it follows that Sy(f) = 02 for alt f and 
oè 2 
SP) = FIG (6.2.11) 


In this case, the power spectrum of V(t) is dependent entirely on the spectral characteristics 
of the pulse g(r). 


ILLUSTRATIVE PROBLEM 


Mustrative Problem 6.1 Determine the power spectrum of V(r) when fan} is an uncorre- 
lated sequence and g(r) is the rectangular pulse shown in Figure 6.1. 





Figure 6.1: Transmitter pulse. 
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Ei 


The Fourier transform of g(t) is 





G) = J © gine Plt at 


z TEE eT (6.2.12) 
and 
2 
sn =o? (SE) A 


This power specirum is illustrated in Figure 6.2. 





uy 











Figure 6.2: Power spectrum of the transmitted signal in Illustrative Problem 6.1 (foro? = 1). 


The MATLAB script for this computation is given below. 


e —— 








% MATLAB script for Iustrative Problem 1, Chapter 6. 
echo on 

Tt; 

deltaf=1/(100#T); 
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Sv=sgma_a*2asine(f+T)."2: 
% plotting command follows 
plot(f.S¥); 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 6.2 Suppose the autocorrelation function of the sequence {an} is 








, m=0 
m=i -l (6.2.14) 


1 
Ram) = $4 
0, otherwise 


and g(t) is the rectangular pulse shown in Figure 6.1. Evaluate $,(f) in this case. 


Eis 


The power spectrum of the PAM signal V(1) is given by (6.2.8). The power spectrum 
of the sequence {an} is, from (6.2.9) and (6.2.14), 





Salf) = | +cos2xfT 





=2cos a fT (6.2.15) 
Consequently, 
A 2 
Sy(f) =2cos?rfT (=5) (6.2.16) 


The graph of this power spectrum is shown in Figure 6.3. 
The MATLAB script for performing this computation is given below. In this case, the 


overall power spectrum of the transmitted signal V(t) is significantly narrower than the 
spectrum in Figure 6.2. 


<==. 


% MATLAB script for Illustrative Problem 2, Chapter 6. 
echo on 

T=1, 

delta_f=1/(100*T); 

f=—5/T:delta_f:5/T; 

Sv=2x(cos(pi+f+T).xsinc(f*T)).*2; 

% plotting command follows 

plot(£,Sv); 
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Figure 6.3: The power spectrum of the transmitted signal in Illustrative Problem 6.2 (for 
2 
o =i). 


6.3 Characterization of Bandlimited Channels 
and Channel Distortion 


Many communication channels, including telephone channels and some radio channels, 
may be generally characterized as bandlimited linear filters. Consequently, such channels 
are described by their frequency response C (f), which may be expressed as 


Cf) = AC fe (63.1) 


where A( f) is called the amplitude response and 0 ( f) is called the phase response. Another 
characteristic that is sometimes used in place of the phase response is the envelope delay, 
or group delay, which is defined as 


1 dof) 

f= in af (6.3.2) 
A channel is said to be nondistorting, or ideal if, within the bandwidth W occupied by 
the transmitted signal, A( f) = constant and @(f) is a linear function of frequency (or the 
envelope delay t(f) = constant). On the other hand, if A( f) and t(f) are not constant 
within the bandwidth occupied by the transmitted signal, the channel distorts the signal. 
If A(f) is not constant, the distortion is called amplitude distortion, and if ¢( f) is not 

constant, the distortion on the transmitted signal is called delay distortion. 
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As a result of the amplitude and delay distortion caused by the nonideal channel fre- 
quency response characteristic C( f), a succession of pulses transmitted through the channel 
at rates comparable to the bandwidth W are smeared to the point that they are no longer 
distinguishable as well-defined pulses at the receiving terminal. Instead, they overlap, so 
we have intersymbol interference. As an example of the effect of delay distortion on a 
transmitted pulse, Figure 6.4(a) illustrates a bandlimited pulse having zeros periodically 
spaced in time at points labeled +T, +27, etc. When the information is conveyed by the 
pulse amplitude, as in PAM, then one can transmit a sequence of pulses, each of which has 
a peak at the periodic zeros of the other pulses. However, transmission of the puise through 
a channet modeted as having a linear envelope delay characteristic t(f) {quadratic phase 
@(f)] results in the received pulse shown in Figure 6.4(b) having zero crossings that are 
no longer periodically spaced. Consequently, a sequence of successive pulses would be 
smeared into one another, and the peaks of the pulses would no longer be distinguishable. 
Thus the channel detay distortion results in intersymbol interference. As will be discussed 
in this chapter, it is possible to compensate for the nonideai frequency response characteris- 
tic of the channel by use of a filter or equalizer at the demodulator. Figure 6.4(c) illustrates 
the output of a linear equalizer that compensates for the linear distortion in the channel. 

As an example, let us consider the intersymbol interference on a telephone channel. 
Figure 6.5 illustrates the measured average amplitude and delay as a function of frequency 
for a telephone channel of the switched telecommunications network. We observe that the 
usable band of the channel extends from about 300 Hz to about 3200 Hz. The corresponding 
impulse response of the average channel is shown in Figure 6.6. Its duration is about 10 
ms. In comparison, the transmitted symbol rates on such a channel may be of the order of 
2500 pulses or symbols per second. Hence, intersymbol interference might extend over 20 
to 30 symbois. 

Besides telephone channels, there are other physical channels that exhibit some form 
of time dispersion and thus introduce intersymbol interference. Radio channels, such as 
shortwave ionospheric propagation (HF), tropospheric scatter, and mobile cellutar radio are 
three examples of time-dispersive wireless channels. In these channels, time dispersion~ 
and, hence, intersymbol interference—is the result of multiple propagation paths with dif- 
ferent path delays. The number of paths aad the relative time delays among the paths vary 
with time; for this reason, these radio channels are usually called time-variant multipath 
channels. The time-variant multipath conditions give rise to a wide variety of frequency 
response characteristics. Consequently the frequency response characterization that is used 
for telephone channels is inappropriate for time-variant multipath channels. Instead, these 
radio channels are characterized statistically in terms of the scattering function, which, in 
brief, is a two-dimensional representation of the average received signal power as a function 
of relative time delay and Doppler frequency spread. 

For illustrative purposes. a scattering function measured on a medium-range (150-mi) 
tropospheric scatter channel is shown in Figure 6.7. The total time duration (multipath 
spread) of the channel response is approximately 0.74s on the average, and the spread 
between half-power points in Doppler frequency is a little less than 1 Hz on the strongest 
path and somewhat larger on the other paths. Typically, if transmission occurs at a rate 
of 107 symbols/second over such a channel, the multipath spread of 0.7us will result in 
intersymbol interference that spans about seven symbols. 
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Figure 6.4: Effect of channel distortion: (a) channel input, (b) channet output, (c) equalizer 
output, 
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Figure 6.5: Average amplitude and delay characteristics of a medium-range telephone 
channel. 
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Figure 6.6: Impulse response of the average channel with amplitude and delay shown in 
Figure 6.5. 
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Figure 6.7: Scattering function of a medium-range tropospheric scatter channel. 
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ILLUSTRATIVE P: BLEM 


Illustrative Problem 6.3 As indicated above, a bandlimited communication channel can 
be modeled as a linear filter whose frequency response characteristics match the frequency 
response characteristics of the channel. MATLAB may be used to design digital FIR or IR 
filters that approximate the frequency response characteristics of analog communication 
channels. Suppose that we wish to model an ideal channel having an amplitude response 
A(f) = | for | f} < 2000 Hz and A(f) = 0 for | f] > 2000 Hz and constant detay (linear 
phase) for all f. The sampling rate for the digital filter is selected as F,=10,000 Hz. Since 
the desired phase response is linear, only an FIR filter could satisfy this condition, However, 
it is not possible to achieve a zero response in the stopband. Instead, we select the stopband 
response to be —40 dB and the stopband frequency to be 2500 Hz. In addition, we allow 
for a small amount, 0.5 dB, of ripple in the passband. 


mm SOLUTION J 


The impulse response and the frequency response of a length N = 41 FIR filter that 
meets these specifications is illustrated in Figure 6.8. Since N is odd, the delay through 
the filter is (X + 1)/2 taps, which corresponds to a time delay of (N + 1)/20 ms at the 
sampling rate of F, = 10 KHz. in this example, the FIR filter was designed in MATLAB 
using the Chebyshev approximation method (Remez algorithm) 














% MATLAB script for Ilustrative Problem 3, Chapter 6. 


echo on 
f_cutoff=2000: % the desired cutoff frequency 
f_stopband=2500; % the actual stopbund frequency 


% the sampling frequency 

% ihe normalized passband frequency 
% the normalized stopbund frequency 
% this number is found by experiment 





F=[0 fl f2 1); 





109}; % describes the lowpass filter 
Beremez(N—1,.F.M); % returns the FIR tap coefficients 
% plotting command follows 
figure(1); 


(H.W)=freqz(B); 
Hin-dB=20+log { O(abs(H)); 
ploe(W/(2«pi),H_in_uB); 

figure(2): 
plot(W/(2+pi),(180/pi)xunwrapangle(H))): 
% plot of the impulse response follows 
figure(3); 

stem([0:N—1],B); 


ILLUSTRATIVE PROBLEM 


illustrative Problem 6.4 An alternative method for designing an FIR filter that approxi- 
mates the desired channel characteristics is based on the window method. To be specific, if 
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Figure 6.8: (a) Impulse response. (b). (c) Frequency response of linear phase FIR filter in 
Mlustrative Problem 6.3. 
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the desired channel response is C{ f) fori f| < W and C(f) = 0 for |f| > W, the impulse 
response of the channel is 


w 
A(t) = Í cpe af (6.3.3) 
-wW 
For example, if the channel is ideal, then C(f) = 1, |f| < W, and hence 
sin 2r W 
haya AA (6.3.4) 
mt 


An equivalent digital filter may be implemented by sampling A(r) at t = nTy, where Ty 
is the sampling interval and n = 0,+1,+2,.... Let us now design an FIR filter with 
W = 2000 Hz and F; = 1/7, = 10 KHz. 


Eni 


The sampted version of A(t), ie., hn = h(nT,), is illustrated in Figure 6.9. Since {An} 
has infinite length, we may truncate it at some length M. This truncation is equivalent to 
multiplying {An} by a rectangular window sequence wa = 1 for |n| < (N — 1)/2 and 
wn = 0 for |a| > (N + 1)/2. The impulse response {A} = w,/t,} and the corresponding 
frequency response of the FIR (truncated) filter are illustrated in Figure 6.10 for N = 51. 
Note that the truncated filter has large sidelobes in the stopband. Hence, this FIR filter is 
a poor approximation to the desired channel characteristics. The size of the sidelobes can 
be significantly reduced by employing a smoother window function, such as a Hanning 
or a Hamming window, to truncate the ideal channe! response. Figure 6.11 illustrates the 
impulse response and frequency response of {ah = Waltn} when the window function is 
a Hanning window of length N = 51. MATLAB provides routines to implement several 
different types of window functions. 











% MATLAB script for illustrative Problem 4, Chapter 6. 
echo on 





n=—(Length-1)/2:(Length—1)/2; 

t=Tsen; 

h=2eWeasinc(2*Wet); 

% The rectangular windowed version follows. 

N=61; 

rec.windowed_h=h((Length—N)/2+1(Length+N)/2); 

% Frequency response of rec-windowed.h follows 

[rec_windowed_H.,W 1]=freqz(rec_windowed_h, 1); 

% to normalize the magnitude 

rec. windowed_H_in.dB=20slog 1 0(abs(rec_windowed_H)/abs(rec. windowed_H(1))); 
% The Hanning windowed version follows 

hanning-window=hanning(N); 
hanning-windowed_h=h((Length—N)/2+1:(Length+N)/2).channing_window. ; 
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(hanning.windowed_H,W2)=freqz(hanning_windowed.h.1): 
hanning windowed. H_in_dB=20«log !0(absthanning- windowed H) /abs(hanning. windowed -H(1))): 
% the plotting commands follow 
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Figure 6.9: Samples of h(n) in Illustrative Problem 6.4. 


ILLUSTRATIVE PROBLEM 





Mlustrative Problem 6.5 A two-path (multipath) radio channel can be modeled in the time 
domain, as illustrated in Figure 6.12. Its impulse response may be expressed as 


elt, T) = biT) + ballt — ty) (6.3.5) 


where bı (t) and 2(t) are random processes that represent the time-varying propagation 
behavior of the channel and ry is the delay between the two multipath components. The 
problem is to simulate such a channel on the computer. 


-emn 


We model bı (t) and b2(t) as Gaussian random processes generated by passing white 
Gaussian noise processes through lowpass filters, In discrete time, we may use relatively 
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Figure 6.10: Frequency response of the filter truncated with a rectangular window in Illus- 
trative Problem 6.4 


simple digital IIR filters excited by white Gaussian noise (WGN) sequences. For example, 
a simple lowpass digital filter having two identical poles is described by the z-transform 


Sipe go (=p? 
H(z) = = pe? oae paT (6.3.6) 


or the corresponding difference equation 





by = 2pba-1 — p’bn + (1 = pwn (63.7) 


where {wa} is the input WGN sequence, {bn} is the output sequence, and 0 < p < 1 is 
the pole position. The position of the pole controls the bandwidth of the filter and, hence, 
the rate of variation of {b,}. When P is close to unity (close to the unit circle), the filter 
bandwidth is narrow, whereas when p is close to zero, the bandwidth is wide. Hence, when 
p is close to the unit circle in the z-plane, the filter output sequence changes more slowly 
compared to the case when the pole is close to the origin. 

Figure 6.13 illustrates the output sequences {bin} and {b27} generated by passing sta- 
tistically independent WGN sequences through a filter having p = 0.99. The discrete-time 
channel impulse response 


Cn = bin + bana (6.3.8) 


is also shown, with d = 5 samples of delay. Figure 6.14 illustrates the sequences {bun}, 
fban}, and {ca} when p = 0.9. 


6.4 Characterization of Intersymbol Interference 


In adigital communication system, channel distortion causes intersymbol interference (ISI). 
In this section, we shall present a model that characterizes ISI. For simplicity, we assume 
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Figure 6.11: Frequency response of filter truncated with Hanning window in Illustrative 
Problem 6.4. 
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Figure 6,12: Two-path radio channel model. 


that the transmitted signal is a baseband PAM signal. However, this treatment is easily 
extended to carrier (linearly) modulated signals discussed in the next chapter. 
The transmitted PAM signal is expressed as 


5(0) = J ang(t — nT) (6.4.1) 


n=0 


where g(t) is the basic pulse shape that is selected to control the spectral characteristics 
of the transmitted signal, (aq) is the sequence of transmitted information symbols selected 
from a signal constellation consisting of M points, and T is the signal interval (1/T is the 
symbol rate). 

The signal s(t) is transmitted over a baseband channel, which may be characterized by 
a frequency response C(f). Consequently, the received signal can be represented as 
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Figure 6.13: Outputs 51, and bzn of a lowpass filter and the resulting cn for p = 0.99. 


r) = J ahlt — nT) + wl) (6.4.2) 
a=0 


where A(t} = g(t)*c(t), c(t) 1s the impulse response of the channel, + denotes convolution, 
and w(t) represents the additive noise in the channel, To characterize ISI, suppose that 
the received signal is passed through a receiving filter and then sampled at the rate 1/T 
samples/seconds. In general, the optimum filter at the receiver is matched to the received 
signal pulse A(t). Hence, the frequency response of this filter is H*(f). We denote its 
output as 


ES 
ID = Do axt = nT) + v(t) (6.4.3) 


n=O 


where x(t) is the signal pulse response of the receiving filter, i.e., X(f) = H(f)H*(f) 
= |H(f)I, and v(t) is the response of the receiving filter to the noise w(t). Now, if y(t) 
is sampled at times ¢ = kT, k =0,1,2,..., we have 
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Figure 6.14: Outputs bin, ban, and ca with pole at p = 0.9 (from top to bottom atn = 1000, 
bins Cn, and bzn). 


WRT) = J anx(kT — nT) + (kT) 


n=0 


œ% 
I=} antton t w,  k=0, 1... (6.4.4) 
=0 


The sample values {y+} can be expressed as 


12 
Ye = X0 et g Le Maticn +u, k=0,1,... (6.4.5) 


nek 


The term xo is an arbitrary scale factor, which we set equal to unity for convenience. Then 


EE, 
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= 
deS UE +Y Antton + Ye (6.4.6) 





The term ay represents the desired information symbol at the kth sampling instant, the term 





(6.4.7) 
asd 
nék 

represents the ISI, and vu, is the additive noise at the kth sampling instant. 

The amount of ISI and noise in a digital communications system can be viewed on an 
oscilloscope. For PAM signals, we can display the received signal y(1) on the vertical input 
with the horizontal sweep rate setat 1/7. The resulting oscilloscope display is called an eye 
Pattern because of its resemblance to the human eye. For example, Figure 6.15 illustrates 
the eye patterns for binary and four-level PAM modulation. The effect of ISI is to cause 
the eye to close, thereby reducing the margin for additive noise to cause errors. Figure 6.16 
graphically illustrates the effect of ISI in reducing the opening of a binary eye. Note that 
intersymbol interference distorts the position of the zero-crossings and causes a reduction 
in the eye opening. Thus, it causes the system to be more sensitive to a synchronization 
error. 


ILLUSTRATIVE PROBLEM 


Ulustrative Problem 6.6 In this problem we consider the effect of intersymbol interference 
(ISH on the received signal sequence { yz} for two channels that result in the sequences {x,} 
as follows: 





Channel 1 
1, n=0 
«= | 7025. n=l 
se 0.1, n=+2 
0, otherwise 
Channel 2 
1, n=0 
pe 0.5, n=l 
" )-0.2, n=42 
0, otherwise 


Note that in these channels, the ISI is limited to two symbols on either side of the 
desired transmitted signal. Hence, the cascade of the transmitter and receiver filters and 
the channel at the sampling instants are represented by the equivalent discrete-time FIR 
channel filter shown in Figure 6.17. Now suppose that the transmitted signal sequence 
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Figure 6.15: Examples of eye patterns for binary and quaternary amplitude shift keying (or 
PAM). 


Optimum sampling 


time 

Sensitivity to Distortion of 

timing error zero crossings 
+4 























Peak distortion Noise margin 


Figure 6.16: Effect of intersymbol interference on eye opening. 
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is binary, i.e., {a, = +1}. Then, for Channel 1, the received signal sequence {y,} in the 
absence of noise is shown in Figure 6.18(a), and with additive white Gaussian noise having 
a variance of a? = 0.1. the received signa! sequence is shown in Figure 6.18(b). We note 
that in the absence of noise, the ISI alone does not cause errors at the detector that compares 
the received signal sequence {y,,} with the threshold set to zero. Hence, the eye diagram is 
open in the absence of noise. However, when the additive noise is sufficiently large, errors 
will occur. 
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Figure 6.17: FIR channe! models with ISI. (a) channel 1. (b) channe! 2. 


In the case of Channel 2, the noise-free and noisy (o? =0.1) sequence {yn} is illustrated 
in Figure 6.19. Now, we observe that the ISI can cause errors at the detector that compares 
the received sequence {yn } with the threshold set at zero, even in the absence of noise. Thus, 
for this channel characteristic, the eye is completely closed. 


6.5 Communication System Design for Bandlimited 
Channels 


In this section we consider the design of the transmitter and receiver filters that are suitable 
for a baseband bandlimited channel. Two cases are considered. In the first case, the design 
is based on transmitter and receiver filters that result in zero ISI, In the second case, the 
design is based on transmitter and receiver filters that have a specified (predetermined) 
amount of ISI. Thus, the second design approach leads to a controlled amount of IST. 
The corresponding transmitted signals are called partial response signals. In both cases 
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Figure 6.18: Output of channel model 1 without and with AWGN. (a) no noise. (b) additive 


Gaussian noise with o? = 0.1. 
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Figure 6.19: Output of channel model 2 without and with AWGN. (a) no noise. (b) Additive 


Gaussian noise with variance g? = 0.1. 
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we assume that the channel is ideal: i.e., A(f) and t(f) are constant within the channel 
bandwidth W. For simplicity, we assume that A( f) = | and r(f) =0 


6.5.1 Signal Design for Zero ISI 


The design of bandlimited signals with zero ISI was a problem considered by Nyquist about 
70 years ago. He demonstrated that a necessary and sufficient condition for a signal x (7) 
to have zero ISI, i.e, 


1, n=0 
T)= a 
x(n 0. n#£0 (6.5.1) 


is that its Fourier transform X ( f} satisfy 





where 1/T is the symbol rate. 

In general, there are many signals that can be designed to have this property. One 
of the most commonly used signals in practice has a raised-cosine frequency response 
characteristic, which is defined as 





T. osifis Ge 
XD =A Ffit Gia- t) at < isis (65.3) 
0. \fl> a 


where æ is called the roll-off factor, which takes values in the range 0 < a < 1, and 
1/T is the symbol rate. The frequency response X;c(f) is illustrated in Figure 6.20(a) for 
a=Oa= }, and æ = l. Note that when œ = 0, Xre( f) reduces to an ideal “brick 
wall” physically nonrealizable frequency response with bandwidth occupancy | /2T. The 
frequency 1/2T is called the Nyquist frequency. For œ > 0, the bandwidth occupied by the 
desired signal Xret f} beyond the Nyquist frequency 1/2T is called the excess bandwidth, 
usually expressed as a percentage of the Nyquist frequency. For example, when œ = z, the 
excess bandwidth is 50, and when œ = l, the excess bandwidth is 100. The signal pulse 
Xre(t) having the raised-cosine spectrum is 


sinxt/T cos(xat/T) 


Shater del SLE 5.4 
mt/T 1 —4a2e?/T? (6.5.4) 


Xžre(t) = 


Figure 6.20(b) illustrates xre(t) for a = 0, 4, 1. Since X;e(f) satisfies (6.5.2), we note 
that xpo(t) = Late = O and x(t) = Oat t = kT, k = +1, +2,.... Consequently, at 
the sampling instants + = kT, k # 0, there is no ISI from adjacent symbols when there 





a a pa aca 
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is no channel distortion. However, in the presence of channel distortion, the ISI given by 
(6.4.7) is no longer zero, and a channel equalizer is needed to minimize its effect on system 
performance. Channel equalizers are considered in Section 6.6. 


Xf) 
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Figure 6.20: Raised-cosine frequency response and corresponding pulse shape. (a) Raised- 
cosine frequency response, (b) Pulse shapes for raised-cosine frequency response. 


In an ideal channel, the transmitter and receiver filters are jointly designed for zero ISI 
at the desired sampling instants ¢ = nT. Thus, if Gr(f) is the frequency response of the 
transmitter filter and G g( f ) is the frequency response of the receiver filter, then the product 
(cascade of the two filters) Gr(f)G a(S) is designed to yield zero ISI. For example, if the 
product Gr(f)Gr{f) is selected as 


Gr(f)Gr(f) = X(f) (6.5.5) 


where X,<(f) is the raised-cosine frequency response characteristic, then the ISI at the 
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sampling times £ 
ILLUSTR 


nT is zero. 
VE PROBLEM 








Tilustrative Problem 6.7 We wish to design a digital implementation of the transmitter 


and receiver filters Gr(f) and Gr(f) such that their product satisfies (6.5.5) and Gr( f) 
is the matched filter to Gr(f). 


Entire 


The simplest way to design and implement the transmitter and receiver filters in digital 
form is to employ FIR filters with linear phase (symmetric impulse response). The desired 
magnitude response is 





IGT = IGRI = V Xel f) (6.5.6) 


where Xre( f) is given by (6.5.3). The frequency response is related to the impulse response 
of the digital filter by the equation 


(N =1)/2 


G= JO grme PIM (6.5.7) 
n=-(N-1)/2 


where T, is the sampling interval and N is the length of the filter. Note that N is odd. Since 
Gr(f) is bandlimited, we may select the sampling frequency F; to be at least 2/T. Our 
choice is 


1 4 
F= RF 
or, equivalently, T, = T/4. Hence the folding frequency is F,/2 = 2/T. Since Gr(f)= 
VXrc(f), we may sample X,(f) at equally spaced points in frequency, with frequency 
separation Af = F,/N. Thus we have 


(N=1)/2 
VEMA) = JXelmF IN) = YO grine PrN (65.8) 
n=—(N-1)/2 





The inverse transform relation is 


(N=1)/2 


grín) = ds 


m=a—(N—1)/2 





Am) eaman, noo. AAL 659) 
(NT 2 


Since gr(n) is symmetric, the impulse response of the desired linear phase transmitter 
filter is obtained by delaying gr (n) by (N — 1)/2 samples, The MATLAB scripts for this 
computation are given below. 


eect, 
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— ia 








% MATLAB script for Hiustrative Problem 7, Chapter 6 
echo on 





a=—(N=1)/2(N~1)/2; % the indices for xT 
% the expression for g-T is obtained next 
for i= t-lengthin), 


(N=1)/2:0N—1)/2 
-TO +sqetxre(4am/(N«T).alpha,T ))sex ptj x2 piamanti)/N); 





% derive y Tin{N-1}/2 

n2=0:N=1; 

% ger the frequency response characteristics 

[G-T.W]=freqzig-T.1): 

% normalized magnitude response 
magG_Tin-dB=20«log | abs(G_T}/maxtabstG.T))); 

% impulse response of the cascade uf the transmitter and the receiver filters. 
g-R=g_T, 

imp .resp_of_cascade=convig_R.g_T): 

% platting commands follow 


mm Ed 


function fy} = xretfialpha. T) 
% iylexre(falpha.T) 











% Evaluates the expression Xre(f). The parameters alpha and T 
% must ulsa be given as inputs to the function. 
if (abs(f) > ((1+alpha)/(2+T))), 

y=0; 


elseif (abs(f) > {{1—alpha)/(2*T))), 
¥=(T/2)+(1+cos((pisT/alpha)s(abs(f)—(1 ~alpha)/(2#T)))); 
else 
yt: 
end; 





Figure 6.2 l(a) illustrates g7-(n — Xe), n=0,1,..., N — 1 fora = i and N = 31. 
The corresponding frequency response characteristics are shown in Figure 6.21(b), Note 
that the frequency response is no longer zero for | f| > (1 + «)/T, because the digital filter 
has finite duration. However, the sidelobes in the spectrum are relatively small. Further 
reduction in the sidelobes may be achieved by increasing N. 

Finally, in Figure 6.22, we show the impulse response of the cascade of the transmitter 
and receiver FIR filters. This may be compared with the ideal imputse response obtained 
by sampling x,¢(t) at a rate F; = 4/T. 
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Figure 6.21: Impulse response and frequency response of truncated discrete-time FIR filter 
at transmitter. 


6.5.2 Signal Design for Controlled ISI 


As we have observed from our discussion of signal design for zero ISI, a transmit filter with 
excess bandwidth may be employed to realize practical transmitting and receiving filters 
for bandlimited channels. On the other hand, suppose we choose to relax the condition of 
zero ISI and thus achieve a symbol transmission in a bandwidth W = 1/2T i.e., with no 
excess bandwidth. By allowing for a controlled amount of ISI, we can achieve the rate of 
2W symbols/second. 

We have already seen that the condition of zero IST is x(nT) = O forn £0. However, 
suppose that we design the bandlimited signal to have controlled IST at one time instant. 
This means that we allow one additional nonzero value in the samples {x(nT)}. The ISI 
that we introduce is deterministic, or “controlled”; hence, it can be taken into account at 
the receiver, as discussed below. 

In general, a signal x(¢) that is bandlimited to W hertz, Le, 


X(f) =9, lft > Ww (6.5.10) 
can be represented as 
z n \ sin2a W(t —n/2W) 
= Do a(i) 2x Wet — n/2W) 6571) 


n=-09 


This representation follows from the sampling theorem for bandlimited signals. The spec- 
trum of the bandlimited signal is 
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Figure 6.22: Impulse response of the cascade of the transmitter filter with the matched filter 
at the receiver. 


es 
x=] xei dt 
ms 
lS n 
a 2) y= innfiW 
={2w (aw) . Visw (6.5.12) 
0, fl> W 


One special case that leads to physically realizable transmitting and receiving filters is 
specified by the samples 


n l, n=0,1 
z (aw) SAAT) = |; otherwise (6.5.13) 


The corresponding signal spectrum is 
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[: + enim), lfl<W 


X(f)=)2W 

0, otherwise 
l -j2 xf 
ana ATN ogg f 24 

=lw* ERS (#). HEW: (6.5.14) 
0, otherwise 

Therefore, x(t) is given by 
x(t) = sinc (2Wr) + sine (2Wr — ty (6.5.15) 


where sinc(t) = sin xt /xr. This pulse is called a duobinary signal pulse. It is illustrated 
along with its magnitude spectrum in Figure 6.23. We note that the spectrum decays to zero 
smoothly, which means that physically realizable filters can be designed that approximate 
this spectrum very closely. Thus, a symbol rate of 2W is achieved. 








Figure 6.23: Duobinary signal pulse and its spectrum. 


Another special case that leads to physically realizable transmitting and receiving filters 
is specified by the samples 


I n=l 
n 
x (5) =r = ~i, n=-l (6.5.16) 
0, otherwise 


The corresponding pulse x(t) is given as 


x(t) = sinc(2We + 1) — sine (2W¢ — 1) (6.5.17) 
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and its spectrum is 


l ; 7 j . af 
aw _ RNW a xi 
xc = law i aging Wis (6.5.18) 
0, fraw 


This pulse and its magnitude spectrum are illustrated in Figure 6.24. It is called a modified 
duobinary signal pulse. It is interesting to note that the spectrum of this signał has a zero 
at f = 0, making it suitable for transmission over a channel that does not pass de. 








lX 











Figure 6.24: Modified duobinary signal pulse and its spectrum. 


One can obtain other interesting and physically realizable filter characteristics by se- 
lecting different values for the samples {x(7/2W)} and more than two nonzero samples. 
However, as we select more nonzero samples, the problem of unraveling the controlled ISI 
becomes more cumbersome and impractical. 

The signats obtained when controlled ISI is purposely introduced by selecting two or 
more nonzero samples from the set {x(n/2W)} are called partial response signals. The 
resulting signal pulses allow us to transmit information symbols at the Nyquist rate of 2W 
symbols per second. Thus greater bandwidth efficiency is obtained compared to raised 
cosine signal pulses. 
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ILLUSTRATIVE PROBLEM 


Iustrative Problem 6.8 We wish to design a digital implementation of the transmitter 
and receiver filters Gr(f) and Gpg( f) such that their product is equal to the spectrum of a 
duobinary pulse and G g( f) is the matched filter to Gr(f). 


Ei» —_-- 


To satisfy the frequency domain specification, we have 





1 sa) 
— cos | —}, wW 

IGr(NUGal fl = f W cos (3y Iys (6.5.19) 
0 fl > W 


and, hence, 


). Ew (6.5.20) 
0, ifl> wW 





IGr( P) = 


Now, we follow the same approach as in Illustrative Problem 6.7 to obtain the impulse 
responses for an FIR implementation of the transmitter and receiver filters. Hence, with 
W = 1/2T and F, = $, we have 


c 7) 
T\NT 


and gp(n) = gr (n). The MATLAB script for this computation is given below. 


(N-D/2 


gros E 


ma~(N~1)/2 


N-I 
giai p20, £1, 42,0... 


(6.5.21) 














% MATLAB script for Illustrative Problem 8, Chapter 6. 
echo on 

N=31; 

T: 





(2+T), 
n=~(N—1)/2(N-1)/2; 
% The expression for g-T is obtained next 
for i=1-length(n), 
g-T(i)=0; 
for m=—(N—1)/2(N-4)/2, 
if ( abs((4am)/(N*T)) <= W ), 
g-Ti)=g.TC)+sqen((t /W)acos((2api em)/(N#T*W)))sexpGin2epiemen(i)/N); 
end; 
end; 
end; 


% the indices for gT 
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% obtain x Tn{N-11/2) 

n2=0:N-1, 

% obtain the frequency response characteristics 

[G-T.W]=freqz(g.T.1); 

% normalized magnitide response 
magG_T-in_dB=20«log10(abs(G_T)/maxtabsiG.T))); 

% Impulse response of the cascade of the transmitter and the receiver filters. 
g-R=g-T, 

imp-resp-of-cascade=conv(g-R,g-T); 

% plouing commands follow 





Figure 6.25(a) illustrates gr (x - x=) n= 0,1,....N —1 for N = 31, The 


corresponding frequency response characteristic is shown in Figure 6.25(b). Note that the 
frequency response characteristic is no longer zero for | fj > W because the digital filter 
has finite duration, However, the sidelobes in the spectrum are relatively small. Finally, in 
Figure 6.26, we show the impulse response of the cascade of the transmitter and receiver FIR 
filters. This impulse response may be compared with the ideal impulse response obtained 
by sampling x(1) given by (6.5.17) ata rate Fy = 4/T = 8W. 
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Figure 6.25: Impulse response and frequency response of truncated discrete-time duobinary 
FIR filter at the transmitter. 


6.5.3 Precoding for Detection of Partial Response Signals 


For the duobinary signal pulse, x(nT) = 1 forn = 0,1 and 0 otherwise. Hence, the 
samples of the output of the receiver filter Ga(f) are expressed as 


Yk = ak + ak-1 + Vk (6.5.22) 
= bk +v 


where {ax} is the transmitted sequence of amplitudes, {vg} is a sequence of additive Gaussian 
noise samples, and bg = ag + ax—. Let us ignore the noise for the moment and consider 
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Figure 6.26: Impulse response of the cascade of the transmitter filter with the matched filter 
at the receiver. 


the binary case where ag = +] with equal probability. Then, b; takes one of three possible 
values, namely, b, = —2, 0. 2 with corresponding probabilities h 4, and i If ag_ is the 
detected signal from the (k — Hst signaling interval, its effect on bz, the received signal in 
the kth signaling intervat, can be eliminated by subtraction, thus allowing ay to be detected. 
The process can be repeated sequentially for every received symbol. 


The major problem with this procedure is that errors arising from the additive noise tend 
to propagate. For example. if ag_) is detected in error, its effect on ax is not eliminated; 
in effect, it is reinforced by the incorrect subtraction. Consequently, the detection of ax is 
also likely to be in error. 


Error propagation can be prevented by precoding the data at the transmitter instead of 
eliminating the controlled ISI by subtraction at the receiver, The precoding is performed on 
the binary data sequence prior to modulation. From the data sequence {D4} of I’s and 0's 
that is to be transmitted, a new sequence {pz}, called the precoded sequence, is generated. 
For the duobinary signal, the precoded sequence is defined as 


Pr = Dk O prot. k=l1,2,... (6.5.23) 
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Data sequence D; -]i PLEDS 1 0 0jı]JoloTo 1 
i Precoded sequence y | 0| 1) ojii] of ol oiii o 
Transmitted sequence ug | -1 |} [—1]1}1] <1 SPS eae NSL 
Received sequence | ~[O[ 0[0}2] 0]-21-210/212127 0 
{Decoded sequence D | -][1]~1 T1107 11 0770 [i fofefoT i 









































Table 6.1: Binary signaling with duobinary pulses. 


where © denotes modulo-2 subtraction.! Then the transmitted signal amplitude is ag = —1 
if py = Oand a; = 1 if py = 1. That is, 


a =2p -1 (6.5.24) 


The noise-free samples at the output of the receiving filter are given by 


by = ak + ay) 
= (pe — 1) + (2py-1 — 1) 
= 2( pe + pe-1 ~ 1) (6.5.25) 
Consequently, 
l 
Pk + pe-p = 7% +1 (6.5.26) 


Since Dy = py ® px—.. it follows that the data sequence {Dg} is obtained from {by} using 
the relation 





by +1 (mod 2) (6.5.27) 


Therefore, if bg = +2, then Dy = O, and if bk = 0, then Dy = 1. An example that 
illustrates the precoding and decoding operations is given in Table 6.1. 


In the presence of additive noise, the sampled outputs from the receiving filter are given 
by (6.5.22). In this case yy = by + vy is compared with the two thresholds set at +1 and 
—1. The data sequence {Dx} is obtained according to the detection rule 


1, iy] <1 
Dy = 6.5.28) 
0, Iyl = 1 ( ) 
Thus precoding the data allows us to perform symbol-by-symbol detection at the receiver 
without the need for subtraction of previously detected symbols. 
a 


l Although this operation is identical to modulo-2 addition, it is convenient to view the precoding operation for 
duobinary in terms of modulo-2 subtraction. 
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The extension from binary PAM to multilevel PAM using duobinary pulses is straight- 
forward. The M-level transmitted sequence fag} results in a (noise-free) received sequence 
by = ak + agi. k=1,2,3,.. (6.5.29) 


which has 2M — | possible equally spaced amplitude levels. The amplitude levels for the 
sequence {a} are determined from the relation 


ay = 2p, —(M—-1) (6.5.30) 


where {px} is the precoded sequence that is obtained from an M-level data sequence {Dg} 
according to the relation 


Px = DO pr-ı (mod M) (6.5.31) 
where the possible values of the data sequence {Dx} are 0, 1,2,...,M 
In the absence of noise, the samples at the output of the receiving filter may be expressed 
as 
bk = ag + ae 
= [2pe — (M — 1)] + [2pe-1 =M - D] 
= 2[pe + pe-1 -M - D] (6.5.32) 
Hence, 
1 
Pk + Pras z% +(M-1) (6.5.33) 


Since Dy = pe + px-ı (mod M), it follows that the transmitted data {Dg} are recovered 
from the received sequence {bg} by means of the relation 


De = sbi + (M1) (mod M) (6.5.34) 


In the case of modified duobinary pulse, the received signal samples at the output of the 
receiving filter Gg( f) are expressed as 
Vk = Gk — Ak-2 + Vk 
= by + (6.5.35) 


The precoder for the modified duobinary pulse produces the sequence {px} from the data 
sequence {Dx} according to the relation 


Pe = Dx ® pe-2 (mod M) (6.5.36) 


From these relations, it is easy to show that the detection rule for the recovering of the data 
sequence {Dx} from {bx} in the absence of noise is 


Dy = -bę (mod M) (6.5.37) 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 6.9 Let us write a MATLAB program that takes a data sequence 
{Dy}, precodes it for a duobinary pulse transmission system to produce {px}, and maps the 
precoded sequence into the transmitted amplitude levels {ag}. Then from the transmitted 
sequence {ay}, form the received noise-free sequence {bx} and, using the relation in (6.5.34), 
recover the data sequence { Dy}. 


Eiki 


The MATLAB script is given below. By using this program, we can verify the results 
in Table 6.1 for the case where M = 2. 











% MATLAB script for Mustrative Problem 9, Chapter 6 
echo on 
d=(1110100100014); 
p(1)=0; 
for i=1-lengthid) 
pli+ 1 =rem(plip+d(i),.2); 





b(it 1 )=atie t)2a(i; 

dou(i¢ 1=rem(bGi+1)/2+1.2); 
end 
d_out=d_out(2:length(d}+1): 





6.6 Linear Equalizers 


The most common type of channel equalizer used in practice to reduce ISI is a linear FIR 
filter with adjustabie coefficients {ci}, as shown in Figure 6.27. 

On channels whose frequency response characteristics are unknown but time-invariant, 
we may measure the channel characteristics and adjust the parameters of the equalizer; once 
adjusted, the parameters remain fixed during the transmission of data. Such equalizers are 
called preset equalizers. On the other hand, adaptive equalizers update their parameters on 
a periodic basis during the transmission of data, so they are capable of tracking a slowly 
time-varying channel response. 

First, fet us consider the design characteristics for a linear equalizer from a frequency 
domain viewpoint. Figure 6.28 shows a block diagram of a system that employs a linear 
filter as a channel! equalizer. 

The demodulator consists of a receiver filter with frequency response Gg (f) in cascade 
with a channel equalizing filter that has a frequency response G¢(f). As indicated in the 
previous section, the receiver filter response G g( f) is matched to the transmitter response, 
ie., Ga(f) = Gp(f), and the product Ga(f)Gr(f) is usually designed so that either 
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Figure 6.27: Linear transversal filter. 
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Figure 6.28: Block diagram of a system with an equalizer. 
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there is zero ISI at the sarnpling instants as, for example, when Ga(t)Gr(f) = Xel f), or 
controlled ISI for partial response signals. 


For the system shown in Figure 6.28, in which the channel frequency response is not 
ideal, the desired condition for zero ISI is 


Gr fICPGr(fIGE(f) = X(f) (6.6.1) 


where X;c(f) is the desired raised-cosine spectral characteristic. Since Gr(f) Gr(f) = 


Xre( f) by design, the frequency response of the equalizer that compensates for the channel 
distortion is 


1 1 
=> = e 
Cf) ICY 
Thus, the amplitude response of the equalizer is IGe(f)| = 1/IC(f)l, and its phase 


response is @¢(f) = —əc{ f). In this case, the equalizer is said to be the inverse channel 
filter to the channe! response. 


We note that the inverse channel filter completely eliminates ISI caused by the channel. 


Gelf) THAD (6.6.2) 


Since it forces the ISI to be zero at the sampling instants £ = kT fork = 0,1,..., the 
equalizer is called a zero-forcing equalizer. Hence, the input to the detector is simply 
Zk = ak +m, k= Ouse. (6.6.3) 


where ng represents the additive noise and ay is the desired symbol. 

In practice, the IS] caused by channel distortion is usually limited to a finite number of 
symbols on either side of the desired symbol. Hence, the number of terms that constitute 
the ISI in the summation given by (6.4.7) is finite. Asa consequence, in practice the channel 
equalizer is implemented as a finite-duration impulse response (FIR) filter, or transversal 
filter, with adjustable tap coefficients {c,}, as illustrated in Figure 6.27. The time delay 
T between adjacent taps may be selected as large as T, the symbol interval, in which 
case the FIR equalizer is called a symbol-spaced equalizer. In this case the input to the 
equalizer is the sampled sequence given by (6.4.6). However, we note that when the symbol 
rate 1/T < 2W, frequencies in the received signal above the folding frequency 1/T are 
aliased into frequencies below 1/T. In this case, the equalizer compensates for the aliased 
channel-distorted signal. 

On the other hand, when the time delay r between adjacent taps is selected such that 
1/t > 2W > 1/T, noaliasing occurs; hence the inverse channel equalizer compensates for 
the true channel distortion. Since r < T, the channel equalizer is said to have fractionally 
Spaced taps, and it is called a fractionally spaced equalizer, In practice, t is often selected 
att = T/2. Notice that, in this case, the sampling rate at the input to the filter G(f) is 2. 

The impulse response of the FIR equalizer is 


K 
Belt) = JO cnôlt = ne) (6.6.4) 


n=—K 
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and the corresponding frequency response is 


K 
Gelf) = Yo erein (6.6.5) 


n=-K 


where {cn} are the 2K + I equalizer coefficients and K is chosen sufficiently large so that 
the equalizer spans the length of the ISI, i.e., 2K + 1 > L, where L is the number of signal 
samples spanned by the ISI. Since X(f) = Gr(f)C(f)GR(f) and x(t) is the signa! pulse 
corresponding to X(f), the equalized output signal pulse is 





K 
a= = Cp (t — nt) (6.6.6) 
n=-K 


The zero-forcing condition can now be applied to the samples of q (r) taken at times: = mT. 
These samples are 


K 
gimT) = J) cyx(mT =n),  m=0,żl..., EK 16.6.7) 
n=-K 
Since there are 2K + | equalizer coefficients, we can control only 2K + | sampled values 
of g(t). Specifically, we may force the conditions 


K 
qimT) = > enx(mT — nt) 
n=-K 
l m=0 


=t (6.6.8) 
LSE a a E = EE S 


which may be expressed in matrix form as Xe = q, where X is a (2K + 1) x (2K + i) 
matrix with elements x(mT — nT), c is the (2K + 1) coefficient vector, and q is the (2K +1) 
column vector with one nonzero element. Thus, we obtain a set of 2K + 1 linear equations 
for the coefficients of the zero-forcing equalizer. 

We should emphasize that the FIR zero-forcing equalizer does not compietely eliminate 
ISI because it has a finite length. However, as K is increased, the residual {SI can be reduced 
and in the limit of K — 00, the ISI is completely eliminated. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 6.10 Consider a channel distorted pulse x(t), at the input to the equal- 
izer, given by the expression 








1 


= TFT 
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where l/T is the symbo! rate. The pulse is sampled at the rate 2/T and is equalized by a 
zero-forcing equalizer. Let us determine the coefficients of a five-tap zero-forcing equalizer. 


ame SOLUTION 


According to (6.6.8), the zero-forcing equalizer must satisfy the equations 





1, m=0 


A 
Z nT 

T)= So caxtmT - 2) = 

aint) iE T = Ny mae, 22 





The matrix X with elements x(mT — nT /2) is given as 


Pe th ht 
3 6 7 6 i 
pb tb foo 
3 3 0 7 
Sue ol fo 
X=/$ 4 1 4 4 (6.6.9) 
fi, GY Ae “Aes 
7 w F 2 
DW a a 
7% 7 3 
The coefficient vector ¢ and the vector g are given as 
C2 0] 
Caf 0 
emi co q=]! (6.6.10) 
ci 0 
c2 0 


Then, the linear equations Xe = q can be solved by inverting the matrix X. Thus we obtain 


cop = Xq = | -3 (6.6.11) 





Figure 6.29 illustrates the original pulse x(r) and the equalized pulse. Note the small amount 
of residual ISI in the equalized pulse. The MATLAB script for this computation is given 
below. 


"a 


OO 


% MATLAB script for Illustrative Problem 10, Chapter 6. 
echo on 

Tat; 

Fs=2/T; 
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Ts=1/Fs; 
c-opt={-2.2 4.9 -3 4.9 —2.2]: 
540-7 /2:54T: 
xst/H(2/T)0).°2): % sampled pulse 


equalized_x=filter(c_opt.1.[x 0 O}; 

% iw take care of the delay 

equalized. x=equalized_x(3:length(equalized_x)); 

% Now, let us downsample the equalizer output 

for i=1:2:length(equalized_x), 
downsampled_equalizer_output((i+1)/2)=equalized_xti): 

end; 

% plotting commands follow 


% since there will be a delay of nwo samples at the output 
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Figure 6.29: Graph of original puise and equalized pulse in Illustrative Problem 6.10. 


One drawback to the zero-forcing equalizer is that it ignores the presence of additive 
noise. As a consequence, its use may result in significant noise enhancement. This is 
easily seen by noting that in a frequency range where C{ f) is small, the channel equalizer 
Ge(f) = 1/C(f) compensates by placing a large gain in that frequency range. Conse- 
quently, the noise in that frequency range is greatly enhanced. An alternative is to relax the 
zero ISI condition and select the channel equalizer characteristic such that the combined 
power in the residual ISI and the additive noise at the output of the equalizer is minimized. 
A channel equalizer that is optimized based on the minimum mean-square error (MMSE) 
criterion accomplishes the desired goal. 

To elaborate, let us consider the noise corrupted output of the FIR equalizer, which is 


K 
zt) = J cayt ~no) (6.6.12) 
n=-K 


where y(t) is the input to the equalizer, given by (6.4.3). The equalizer output is sampled 
at times t = mT. Thus, we obtain 
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% 
c(mT) = J. cay(mT ~ nv) (6.6.13) 


n=-K 
The desired response at the output of the equalizer at r = mT is the transmitted symbol 


am. The error is defined as the difference between am and z(mT). Then, the mean-square 
error (MSE) between the actual output sample z(mT) and the desired values am is? 


MSE = E |z(mT) — aml? 


K 2 
=E oy Cny(mT — nt) ~ am 
n=-K 
K K K 
=> JO caceRy(n =k) ~2 DO ceRuy(k) + Elam?) (6.6.14) 
n=-K k=-K k K 





where the correlations are defined as 


Ry(n — k) = E[y*(mT — at)y(mT — kr)) 
Ray(k) = ElyQnT — kr)an] (6.6.15) 


and the expectation is taken with respect to the random information sequence {am} and the 
additive noise. 
The minimum MSE solution is obtained by differentiating (6.6.14) with respect to the 


equalizer coefficients {c,}. Thus we obtain the necessary conditions for the minimum MSE 
as 


K 
Do caRs(n =k) = Ray). k =0, 41.42... EK (6.6.16) 
K 





These are the 2K + 1 linear equations for the equalizer coefficients. In contrast to the zero- 
forcing solution described previously, these equations depend on the statisticat properties 
(the autocorrelation) of the noise as well as the ISI through the autocorrelation Ry (7). 

In practice, the autocorrelation matrix Ry (n) and the cross-correlation vector Ray(n) are 
unknown a priori. However, these correlation sequences can be estimated by transmitting 
a test signal over the channel and using the time-average estimates 


2in this development we allow the signals z(t) and ¥(#) to be complex-valued and the data sequence also to be 
complex-valued. 
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K 

5 l 

Rm = g So y*&T ~ ne)y(kT) 
k=l 


K 

$ 1 

Rul = g > y(kT —ntyat (6.6.17) 
ez 


in place of the ensemble averages to solve for the equalizer coefficients given by (6.6.16). 
ILLUSTRATIVE PROBLEM 


Tlustrative Problem 6.11 Let us consider the same channel-distorted pulse x(r) as in 
Illustrative Problem 6.10, but now we shall design the five-tap equalizer based on the 
minimum MSE criterion. The information symbols have zero mean and unit variance and 
are uncorrelated, i.e., 


Elan) = 0 
E(a@n am) = 0, nám 
Ellan’) = 1 


The additive noise v(t} has zero mean and autocorrelation 


Ne 
Pu = PSC) 





—Entiii~— 


The equalizer tap coefficients are obtained by solving (6.6.16) with K = Zandt = 7/2. 
The matrix with elements Ry(n — k) is simply 


N 
Ry =X X+ I 


where X is given by (6.6.9) and I is the identity matrix. The vector with elements Ray (k) 
is given as 


Ray = 


We Ie e ne 


The equalizer coefficients obtained by solving (6.6.16) are as follows: 
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0.0956 
-0.7347 

Cop = | 1.6761 
-0.7347 

0.0956 


A plot of the equalized pulse is shown in Figure 6.30. The MATLAB script for this 
computation is given below. 


e 


% MATLAB script for Hlusirative Problem 11, Chapier 6. 





echo on 

T=1; 

for n=-2:2, 
for k=-2:2, 





temp=temp+(1/(1+n—1)"2))al 4 /(4 4k 1) 2): 

end; 

X(k+3.n+3)stemp: 

end, 

end; 
NO=0.01: % assuming that NO=0.0! 
Ry=X+(NO/2)eeye(5); 
Riy=(1/5 1/2 1 1/2 1/5)": 
c-opt=inv(Ry)sRiy; % optimal tap coefficients 
% find the equalized pulse. 
t2-3:1/2:3; 
KEL f(A +(24t/T).72); % sampled pulse 
equalized_pulse=conv(x,c-opt); 
% decimate the pulse to get the samples at the symbol rate 
decimated_equalized_pulse=equalized.pulse( 1:2:length(equalized_pulse)); 
% plowing command follows 











6.6.1 Adaptive Linear Equalizers 


We have shown that the tap coefficients of a linear equalizer can be determined by solving 
a set of linear equations. In the zero-forcing optimization criterion, the linear equations are 
given by (6.6.8). On the other hand, if the optimization criterion is based on minimizing 
the MSE, the optimum equalizer coefficients are determined by solving the set of linear 
equations given by (6.6.16). 

In both cases, we may express the set of linear equations in the general matrix form 


Be=d (6.6.18) 


where B is a (2K +1) x (2K + 1) matrix, ¢ is a column vector representing the 2K + 1 
equalizer coefficients, and d is a (2K + 1)-dimensional column vector. The solution of 
(6.6.18) yields 
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Figure 6.30: Plot of the equalized pulse in Illustrative Problem 6.11. 


Copt = Bo'd (6.6.19) 


In practical implementations of equalizers, the solution of (6.6.18) for the optimum 
coefficient vector is usually obtained by an iterative procedure that avoids the explicit 
computation of the inverse of the matrix B. The simplest iterative procedure is the method 
of steepest descent, in which one begins by choosing arbitrarily the coefficient vector c, 
say, co. This initial choice of coefficient vector cg corresponds to a point on the criterion 
function that is being optimized. For example, in the case of the MSE criterion, the initial 
guess co corresponds to a point on the quadratic MSE surface in the (2K + 1)-dimensional 
space of coefficients. The gradient vector, defined as go, which is the derivative of the MSE 
with respect to the 2K + | filter coefficients, is then computed at this point on the criterion 
surface, and each tap coefficient is changed in the direction opposite to its corresponding 
gradient component. The change in the jth tap coefficient is proportional to the size of the 
jth gradient component, 

For example, the gradient vector, denoted as gx, for the MSE criterion, found by taking 
the derivatives of the MSE with respect to each of the 2K + 1 coefficients, is 


8k = Be —d, k=0,1,2,... (6.6.20) 


Then the coefficient vector cy is updated according to the relation 


cht = Ck — Age (6.6.21) 


6.6. Linear Equalizers 267 


where A is the step-size parameter for the iterative procedure. To ensure convergence 
of the iterative procedure, A is chosen to be a small positive number. In such a case, the 
gradient vector gy converges toward zero, i.e., gk > ask — 00, and the coefficient 
vector Ck — Copy, a illustrated in Figure 6.31 based on two-dimensional optimization. In 
general, convergence of the equalizer lap coefficients to Cop cannot be attained in a finite 
number of iterations with the steepest-descent method. However, the optimum solution 
opt Can be approached as closely as desired in a few hundred iterations. In digital com- 
munication systems that employ channel equalizers, each iteration corresponds to a time 
interval for sending one symbol; hence, a few hundred iterations to achieve convergence to 
Cop COrrespond to a fraction of a second. 


462 


Initial guess 








SS 


Figure 6.31: Example of the convergence characteristics of a gradient algorithm. 





Adaptive channel equalization is required for channels whose characteristics change 
with time. In such a case, the IS] varies with time. The channel equalizer must track such 
time variations in the channel response and adapt its coefficients to reduce the ISI. In the 
context of the above discussion, the optimum coefficient vector Copt Varies with time due to 
time variations in the matrix B and, for the case of the MSE criterion, time variations in the 
vector d. Under these conditions, the iterative method described above can be modified to 


use estimates of the gradient components. Thus, the algorithm for adjusting the equalizer 
tap coefficients may be expressed as 


Cet) = Ce — AR (6.6.22) 
where 8% denotes an estimate of the gradient vector & and é denotes the estimate of the 
tap coefficient vector. 


In the case of the MSE criterion, the gradient vector gy given by (6.6.20) may also be 
expressed as 


Be = Elery) 
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An estimate ĝe of the gradient vector at the kth iteration is computed as 


Èr = -eK (6.6.23) 


where eg denotes the difference between the desired output from the equalizer at the kthtime 
instant and the actual output z(k T) and yę denotes the column vector of 2K + | received 
signal values contained in the equalizer at time instant k. The error signal ex is expressed 
as 


TREET (6.6.24) 


where z = c(kT) is the equalizer output given by (6.6.13) and ax is the desired symbol. 
Hence, by substituting (6.6.23) into (6.6.22), we obtain the adaptive algorithm for optimizing 
the taps coefficients (based on the MSE criterion) as 


bay = êk + Ace ye (6.6.25) 


Since an estimate of the gradient vector is used in (6.6.25), the algorithm is called a stochastic 
gradient algorithm, Itis also known as the LMS algorithm. 

A block diagram of an adaptive equalizer that adapts its tap coefficients according to 
(6.6.25) is illustrated in Figure 6.32. Note that the difference between the desired output 
ag and the actual output zę from the equalizer is used to form the error signal ex. This 
error is scaled by the step-size parameter A, and the scaled error signal Aeg multiples the 
received signal values (y(kT — nt)} atthe 2K + | taps. The products Aeg y* (kT — nt) at 
the 2K + | taps are then added to the previous values of the tap coefficients to obtain the 
updated tap coefficients, according to (6.6.25). This computation is repeated as each new 
signal sample is received. Thus, the equalizer coefficients are updated at the symbol! rate. 

Initially, the adaptive equalizer is trained by the transmission of a known pseudorandom 
sequence {am} over the channel. At the demodulator, the equalizer employs the known 
sequence to adjust its coefficients. Upon initial adjustment, the adaptive equalizer switches 
from a training mode to a decision-directed mode, in which case the decisions at the output 
of the detector are sufficiently reliable so that the error signal is formed by computing the 
difference between the detector output and the equalizer output, i.e., 


ek = Gk — Zk (6.6.26) 


where âx is the output of the detector. In general, decision errors at the output of the detector 
occur infrequently; consequently, such errors have little effect on the performance of the 
tracking algorithm given by (6.6.25). 

A tule of thumb for selecting the step-size parameter in order to ensure convergence 
and good tracking capabilities in slowly varying channels is 


1 


= 6.6.27 
5(2K + \)Pr f : 


A 
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Figure 6.32: Linear adaptive equalizer based on the MSE criterion. 


where Pe denotes the received signal-plus-noise power, which can be estimated from the 
received signal. 


ILLUSTRATIVE PROBLEM 


Hlustrative Problem 6.12 Let us implement an adaptive equalizer based on the LMS 
algorithm given in (6.6.25). The channel number of taps selected for the equalizer is 
2K +1 = li. The received signal-plus-noise power Pp is normalized to unity. The 
channel characteristic is given by the vector x as 


x = [0.05 — 0.063 0.088 —0.126 ~0.25 0.9047 0.25 O 0.126 0.038 0.088] 


f The convergence characteristics of the stochastic gradient algorithm in (6.6.25) are 
illustrated in Figure 6.33. These graphs were obtained from a computer simulation of the 
11-tap adaptive equalizer. The graphs represent the mean-square error averaged over several 
realizations. As shown, when A is decreased, the convergence is slowed somewhat, but a 
lower MSE is achieved, indicating that the estimated coefficients are closer to Copt. 

The MATLAB script for this example is given below. : 





% MATLAB script for Illustrative Problem 12, Chapter 6 
echo on 


N=500; Ge lengih of the information sequence 
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Figure 6.33: Initial convergence characteristics of the LMS algorithm with different step 
sizes. 


K=5; 
actual_isi=[0.05 -0.063 0.088 -0.126 —0.25 0.9047 0.25 0 0.126 0.038 0.088): 
sigma=0.01; 
115; 
f-realizations=1000; 
zeros(1,N~2+*K); 
for j=1:Num_of_realizations, 
% the information sequence 
for i=1:N, 
if (rand<0.5), 
info(i)=—1; 
else 
info(i)=1,, 
end; 
end; 
% the channel output 
y=filter(actual_isi,1 info); 
for i=1:2:N, 
{noise(i) noise(i+1)]=gngauss(sigma}; 
end; 
y=y+noise; 
% now the equalization part follows 








% compute the average aver a number of realizations 
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estimated-c=[0 0000100000]; % initia! estimate of IST 





z_k=estimated.cxy_k.' ; 
e-k=info(k)—z_k; 
estimated_c=estimated_c+deltaxe_kay_k: 
mse(k)=e_k 2; 
end; 
mse -av=mse_av+mse; 
end; 
mse_av=mse_av/Num_of_ceatizations % mean-square error versus iterations 
% plotting commands follow 





Although we have described in some detail the operation of an adaptive equalizer that 
is optimized on the basis of the MSE criterion, the operation of an adaptive equalizer 
based on the zero-torcing method is very similar. The major difference lies in the method 
for estimating the gradient vectors gg at each iteration. A block diagram of an adaptive 
7er0-forcing equalizer is shown in Figure 6.34 
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Figure 6.34: An adaptive zero-forcing equalizer. 


6.7 Nonlinear Equalizers 


The linear filter equalizers described above are very effective on channels, such as wire line 
telephone channels, where the ISI is not severe. The severity of the ISI is directly related 
to the spectral characteristics of the channel and not necessarily to the time span of the ISI, 
For example, consider the ISI resulting from two channels, illustrated in Figure 6.35. The 
time span for the ISI in Channel A is five symbol intervals on each side of the desired signal 
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component, which has a value of 0.72. On the other hand, the time span for the ISI in 
Channel B is one symbol interval on each side of the desired signal component, which has 
a value of 0.815. The energy of the total response is normalized to unity for both channels. 








ogis 
O72 0.407 0.407 
036- 921 
0.07 
0.03 
bel be Tbe 7 — 
-0.21 
-0.5 
(a) Channel A (b) Channel B 


Figure 6.35: Two channels with ISI. 


In spite of the shorter ISI span, channel B results in more severe ISI. This is evidenced 
in the frequency response characteristics of these channels, which are shown in Figure 6.36. 
We observe that channel B has a spectral null (the frequency response C(f} = 0 for some 
frequencies in the band |f| < W) at f = 1/2T. whereas this does not occur in the case 
of channel A. Consequently, a linear equalizer will introduce a large gain in its frequency 
response to compensate for the channel null. Thus, the noise in channel B will be enhanced 
much more than in channel A. This implies that the performance of the linear equalizer for 
channel B will be sufficiently poorer than that for channel A. In general, the basic limitation 
of a linear equalizer is that it performs poorly on channels having spectral nulls. Such 
channels are often encountered in radio communications, such as ionospheric transmission 
at frequencies below 30 MHz and mobile radio channels, such as those used for cellular 
radio communications. 

A decision-feedback equalizer (DFE) is a nonlinear equalizer that employs previous 
decisions to eliminate the ISI caused by previously detected symbols on the current symbol 
to be detected. A simple block diagram for a DFE is shown in Figure 6.37. The DFE consists 
of two filters, The first filter is called a feedforward filter; it is generally a fractionally 
spaced FIR filter with adjustable tap coefficients. This filter is identical in form to the linear 
equalizer described above. Its input is the received filtered signal y(+) sampled at some rate 
that is a multiple of the symbol rate, e.g., at rate 2/T. The second filter is a feedback filter. 
It is implemented as an FIR filter with symbol-spaced taps having adjustable coefficients. 
Its input is the set of previously detected symbols. The output of the feedback filter is 
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Figure 6.36: Amplitude spectra for (a) channel A shown in Figure 6.35(a) and (b) channel 
B shown in Figure 6.35(b). 


subtracted from the output of the feedforward filter to form the input to the detector, Thus, 
we have 


Ny Ny 
in = Dd cayonT ki Y brå, a 


n= 





n=l 


where {c,} and {b,,} are the adjustable coefficients of the feedforward and feedback filters, 
respectively, @m—n, n = 1,2,..., N2, are the previously detected symbols, N is the length 
of the feedforward filter, and N3 is the length of the feedback filter. Based on the input 
Zm. the detector determines which of the possible transmitted symbols is closest in distance 
to the input signal &m. Thus it makes its decision and outputs åm. What makes the DFE 
nonlinear is the nonlinear characteristic of the detector that provides the input to the feedback 
filter. 

The tap coefficients of the feedforward and feedback filters are selected to optimize some 
desired performance measure. For mathematical simplicity, the MSE criterion is usually 
applied, and a stochastic gradient algorithm is commonly used to implement an adaptive 
DFE. Figure 6.38 illustrates the block diagram of an adaptive DFE whose tap coefficients 
are adjusted by means of the LMS stochastic gradient algorithm. 

We should mention that decision errors from the detector that are fed to the feedback filter 
have a small effect on the performance of the DFE. In general, a smalt loss in performance 
of 1 to 2 dB is possible at error rates below 107”, but the decision errors in the feedback 
filters are not catastrophic. 

Although the DFE outperforms a linear equalizer, it is not the optimum equalizer from 
the viewpoint of minimizing the probability of error in the detection of the information 
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Figure 6.38: Adaptive DFE. 
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sequence {az} from the received signal samples {y4} given in (6.4.6). In a digital com- 
munication system that transmits information over a channel that causes ISI, the optimum 
detector is a maximum-likclihood symbol sequence detector that produces at its output the 
most probable symbol sequence {ã;} for the given received sampled sequence {yg}. That 
is, the detector finds the sequence {aj} that maximizes the likelihood function 


Adah = In pUlye} | fag) 


where p({yx} | {arh is the joint probability of the received sequence {y} conditioned on 
{ax}. The sequence of symbols {a} that maximizes this joint conditional probability is 
called the matimum-likelihood sequence detector. 

An algorithm that implements maximum-likelinood sequence detection (MLSD) is the 
Viterbi algorithm, which was originally devised for decoding convolutional codes as de- 
scribed in Section 8.3.2. For a description of this algorithm in the context of sequence 
detection in the presence of ISI, the reader is referred to [3,4]. 

The major drawback of MLSD for channels with ISI is the exponential behavior in 
computational complexity as a function of the span of the IST. Consequently, MLSD is 
practical only for channels where the ISI spans only a few symbols and the ISI is severe, 
in the sense that it causes a severe degradation in the performance of a linear equalizer or 
a decision-feedback equalizer. For example, Figure 6.39 illustrates the error probability 
performance of the Viterbi algorithm for a binary PAM signal transmitted through channel 
B (see Figure 6.35). For purposes of comparison, we also illustrate the probability of 
error for a DFE. Both results were obtained by computer simulation. We observe that the 
performance of the ML sequence detector is about 4.5 dB better than that of the DFE at 
an error probability of 10-4. Hence, this is one example where the ML sequence detector 
provides a significant performance gain on a channel with a relatively short ISI span, 

In conclusion, channel equalizers are widely used in digital communication systems to 
mitigate the effects of ISI cause by channel distortion. Linear equalizers are generaily used 
for high-speed modems that transmit data over telephone channels. For wireless (radio) 
transmission, such as mobile cellular communications and interoffice communications, the 
multipath propagation of the transmitted signal results in severe ISI, Such channels require 
more powerful equalizers to combat the severe ISI. The decision-feedback equalizer and 


the MLSD are two nonlinear channel equalizers that are suitable for radio channels with 
severe ISI. 
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Figure 6.39: Error probability of the Viterbi algorithm for a binary PAM signa! transmitted 
through Channel B in Figure 6.35. 
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Problems 


6.1 The Fourier transform of the rectangular pulse in Illustrative Problem 6.1 and the power 
spectrum S,(f) can be computed numerically with MATLAB by using the discrete Fourier 
transform (DFT) or the FFT algorithm. Let us normalize T = | and o? = 1. Then, sample 
the rectangular pulse g(t) att = k/10 fork =0,1,2,..., 127. This yields the sequence 
{gx} of sample values of g(t). Use MATLAB to compute the 128-point DFT of {g4} and 
plot the values |Gm}? for m = 0, 1,..., 127. Also plot the exact spectrum | G( f) |? given 
in (6.2.13) and compare the two results. 


6.2 Repeat the computation in Problem 6.1 when the pulse g(t) given as 


L 7 
(1 cos Ft), Osr<sT 
gy = 42 T 


NI 


e 


otherwise 
Let T = 1 for this computation. 


6.3 Write a MATLAB program to compute the power spectrum Sy( f) of the signal V(r) 
when the pulse g(r) is 


l 2ne 
z t= cos E), O<tsT 
g= 42 T 
0, otherwise 


and the sequence (a,,} of signal amplitudes has the correlation function given by (6.2.14). 


6.4 Use MATLAB to design an FIR linear-phase filter that models a lowpass bandlimited 
channel that has a }-dB ripple in the passband | f |< 3000 Hz and a stopband attenuation 
of —40 dB for | f} > 3500. Piot the impulse response and the frequency response. 


6.5 Write a MATLAB program to design an FIR linear phase filter that models a lowpass 
bandiimited channel with desired amplitude response 


-IL IfI < 3000 
A = 9, f > 3000 
via the window method, using a Hanning window. 


6.6 Write a MATLAB program that generates the impulse response for the two-path mul- 
tipath channel in Illustrative Problem 6.5 and plot the impulse response for p = 0,95 and 
a delay of 5 samples. 
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6.7 Write a MATLAB simulation program that implements channel | in Illustrative Problem 
6.6, and measure the error rate when 10,000 binary data {1} are transmitted through this 
channel. The channel is corrupted by AWGN with variance o? = 0, o? = 0.1, o? = 
0.2, a? = 0.5 and o? = 1.0. 


6.8 Repeat Problem 6.7 for the following channel: 


i, n=0 
Xn = 90.25, n=tl 
0, otherwise 


6.9 Write a MATLAB program that generates the sampled version of the transmit filter 
impulse response gr(t) given by (6.5.9) for an arbitrary value of the roll-off factor œ. 
Evaluate and plot gr(n) fora = $ and N = 31. Also, evaluate and plot the magnitude 
of the frequency response characteristic for this filter. (Use a 4N-point DFT of gr (n) by 
padding gr(n) with 3N zeros.) 


6.10 Write a MATLAB program that computes the overall impulse response of the cascade 
of any transmit filter g7 (7) with its matched filter at the receiver. This computation may be 
performed by use of the DFT as follows. Pad gr (n) with N — 1 (or more) O's and compute 
the (2N — 1)-point (or more) DFT. This yields Gr(k) . Then form {G7 (k)|? and compute 
the (2N — 1)-point inverse DFT of |G7r(k)|?. Evaluate this overall impuise response for 
the filter in Problem 6.9 and compare this result with the ideal impulse response obtained 
by sampling x,-(t) ata rate F; = 4/T. 


6.11 Repeat Problem 6.9 for N = 21 and N = 41. Plotand compare the frequency response 
of the discrete-time filters with those in Problem 6.9. Describe the major differences. 


6.12 Write a MATLAB program that takes a data sequence {Dz}, precodes it for a modified 
duobinary pulse transmission system to produce {pg}, and maps the precoded sequence 
into the transmitted amplitude levels {ag}. Then from the transmitted sequence, form the 
received noise-free sequence {bg = ag — ay—2} and, using the relation given by (6.5.36), 
recover the data signal {Dx}. Run the program for any pseudorandom data sequence {Dx} 
for M = 2 and M = 4 transmitted amplitude levels and check the results. 


6.13 Write a MATLAB program that performs a Monte Carlo simulation of a binary PAM. 
communication system that employs duobinary signal pulse, where the precoding and am- 
plitude sequence {a} are performed as in Illustrative Problem 6.9. Add Gaussian noise 
to the received sequence {bx} as indicated in (6.5.22) to form the input to the detector and 
use the detection rule in (6.5.28) to recover the data. Perform the simulation for 10,000 
bits and measure the bit-error probability for ¢? = 0.1, ø? = 0.5, and o? = H. Plot 
the theoretical error probability for binary PAM with no ISI and compare the Monte Carlo 
simulation results with this ideal performance. You should observe some small degradation 
in the performance of the duobinary system. 
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6.14 Repeat Problem 6.9 for a sampling rate F, = 8/T,a = 4, and N = 61. Does the 


higher sampling rate result in a better frequency response characteristic, i.e., a closer match 
to Xel f)? 


6.15 For the filter designed in Problem 6.14, compute and plot the output of the cascade of 
this filter with its matched filter using the procedure described in Problem 6.10. Compare 
this sampled impulse response with the ideal impulse response obtained by sampling x;¢(t) 
at arate F, = 8/T. Does this higher sampling rate result in a better approximation of the 
discrete-time filter impulse response to the ideal filter impulse response? 


6.16 Write a MATLAB program that generates the sampled version of the transmit filter 
impulse response g7(t) given by (6.5.21) for the modified duobinary pulse specified by 
(6.5.18). Evaluate and plot gr(n) for N = 31. Also, evaluate and plot the magnitude of 
the frequency response of this filter. 


6.17 Repeat Problem 6.10 for the filter designed in Problem 6.16. 


6.18 Repeat Problem 6.16 for N = 21 and N = 41. Compare the frequency responses of 
these filters with the frequency response of the filter designed in Problem 6.16. What are 
the major differences in these frequency response characteristics? 


6.19 Consider the channel distorted pulse x(t) given in Illustrative Problem 6.10. The pulse 
is sampled at the rate 2/7 and equalized by a zero-forcing equalizer with 2K +1 = 1 
taps. Write a MATLAB program to solve for the coefficients of the zero-forcing equalizer. 
Evaluate and plot the output of this zero-forcing equalizer for 50 sampled values. 


6.20 Repeat Problem 6.19 fora MSE equalizer with No = 0.01, No = 0.1, and No = 1.0. 
Compare these equalizer coefficients with those obtained in Problem 6.19 and comment on 
the results as Ny is varied. 


6.21 Write a general MATLAB program for computing the tap coefficients of an FIR 
equalizer of arbitrary length 2K + 1 based on the MSE criterion, given as input the sampled 
values of the pulse x(r) taken at the symbol rate and the spectral density of the additive 
noise No. Use the program to evaluate the coefficients of an 11-tap equalizer when the 
sampled values of x(t) are 


loons 
05, n= 
x(aT) = 
“ 03, n=43 
Ol, n=44 


No = 0.01, and No = 0.1. Also, evaluate the minimum MSE for the optimum equalizer 
coefficients. 
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6.22 For the channel characteristics given in Problem 6.21, evaluate the coefficients of the 
MSE equalizer and the minimum MSE when the number of equalizer taps is 21. Compare 
these equalizer coefficients with the values of the coefficients obtained in Problem 6.21 
and comment on whether the reduction in the MSE obtained with the longer equalizer is 
sufficiently large to justify its use. 


6.23 The amount of residual ISI at the output of an equalizer can be evaluated by convolving 
the channel sampled response with the equalizer coefficients and observing the resulting 
output sequence. Write a MATLAB program that computes the output of the equalizer 
of a specified length when the input is the sampled channel characteristic. For simplicity, 
consider the case where the equalizer is a symbol-spaced equalizer and the channel sampled 
response also consists of symbol-spaced samples. Use the program to evaluate the output 
of azero-forcing, symbol-spaced equalizer for the channel response given in Problem 6.21. 


6.24 Write a MATLAB Monte Carlo simulation program that simulates the digital commu- 
nication system that is modeled in Figure P6.24. The channel is modeled as an FIR filter 
with symbol-spaced values. The MSE equalizer is also an FIR filter with symbol-spaced 
tap coefficients. Training symbols are transmitted initially to train the equalizer. In the 
data mode, the equalizer employs the output of the detector in forming the error signal. 
Perform a Monte Carlo simulation of the system using 1000 training (binary) symbols and 
10,000 binary data symbols for the channel model given in Problem 6.21. Use No = 0.01, 
No = 0.1, and No = 1. Compare the measured error rate with that of an ideat channe! with 
no ISI. 
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Chapter 7 


Digital Transmission via Carrier 
Modulation 


7.1 Preview 


In the two previous chapters we considered the transmission of digital information through 
baseband channels. In such a case, the information-bearing signal is transmitted directly 
through the channel without the use of a sinusoidal carrier. However, most communication 
channels are bandpass channels; hence, the only way to transmit signals through such 
channels is by shifting the frequency of the information-bearing signal to the frequency 
band of the channel. 

In this chapter, we consider four types of carrier-modulated signals that are suitable for 
bandpass channels: amplitude-modulated signals. quadrature-amplitude-modulated sig- 
nals, phase-shift keying, and frequency-shift keying. 


7.2 Carrier-Amplitude Modulation 


In baseband digital PAM, the signal waveforms have the form 


3m(t) = Amgr(t) (7.2.1) 


where Am is the amplitude of the mth waveforms and gy (t) is a pulse whose shape deter- 
mines the spectral characteristics of the transmitted signal. The spectrum of the baseband 
signals is assumed to be contained in the frequency band |f| < W, where W is the band- 
width of |Gr(f)|*, as illustrated in Figure 7.1. Recall that the signal amplitude takes the 
discrete values 


Am = (2m — 1 — M)d, m=1,2,...,M (7.2.2) 
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IGN! 





of 


Figure 7.1: Energy density spectrum of the transmitted signal g7 (7). 


where 2d is the Euclidean distance between two adjacent signal points. 

To transmit the digital signal waveforms through a bandpass channel, the baseband 
signal waveforms s(t), m = 1,2,..., M are multiplied by a sinusoidal carrier of the 
form cos 2x fet, as shown in Figure 7.2, where f, is the carrier frequency (fe > W) and 
corresponds to the center frequency in the passband of the channel. Hence, the transmitted 
signal waveforms are expressed as 


Um(t) = Amgr (t) cos 27 fet, m=1,2,...,.M (7.2.3) 


In the special case when the transmitted pulse shape gr(t) is rectangular, i.e., 


2 
gr) = E Srs 


0, otherwise 


the amplitude-modulated carrier signal is usually called amplitude shift keying (ASK). In 
this case the PAM signal is not bandlimited. 


Baseband Bandpass signal 
signal Spit) COS 2ft 
Sp(t) 
Carrier 
cos (27rf.t) 


Figure 7.2: Amplitude modulation of a sinusoidal carrier by the baseband PAM signal. 


Amplitude modulation of the carrier cos 27 fet by the baseband signal waveforms Sm (t) 
shifts the spectrum of the baseband signal by an amount fo and, thus, places the signal 


rene eg OME 
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into the passband of the channel. Recall that the Fourier transform of the carrier is [6( f — 
e) HSCF + f.)1/2. Since multiplication of two signals in the time domain corresponds 


to the convolution of their spectra in the frequency domain, the spectrum of the amplitude- 
modulated signal is 


An 
Unf) = SGT = fI+GrF + fel (7.2.4) 


Thus, the spectrum of the baseband signal sm(t) = Amgr(t) is shifted in frequency by the 
carrier frequency fe. The bandpass signal is a double-sideband suppressed-carrier (DSB- 
SC) AM signal, as illustrated in Figure 7.3. 


HOLP! 
i 


=W 0 w 
(a) 


pUl 








Figure 7.3: Spectra of (a) baseband and (b) amplitude-modulated signal. 
We note that impressing the baseband signal Sm(t) onto the amplitude of the carrier 


signal cos 27 f-(t) does not change the basic geometric representation of the digital PAM. 
signal waveforms. The bandpass PAM signal waveforms may be represented in general as 


uml!) = Sm (t) (7.2.5) 
where the signal waveform y(t) is defined as 


YC) = gr(t) cos 27 fet (1.2.6) 
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and 


Sm = Åm. m=1,2,...,M (2.7) 


denotes the signal points that take the M values on the real fine, as shown in Figure 7.4. 





-sd -34d =d 0 d 3d 5d 


Figure 7.4: Signal point constellation for PAM signal. 


The signal waveform wW (7) is normalized to unit energy. That is, 


E ydi=! (1.2.8) 


Consequently, 


œ Le 
J gdi + = f gi(thcos4n fet di 
as 2 


-æ 


se 2 
f s70) cos” 2x fet dt = 


=o 





(7.2.9) 


di 


But 


20 
f g(t) cos4n fet di = 0 (7.2.10) 


-%0 


because the bandwidth W of gr (t) is much smaller than the carrier frequency, i.e., fe > W. 
In such a case, gy (t) is essentially constant within any one cycle of cos 47 fet; hence, the . 
integral in (7.2.10) is equal to zero for each cycle of the integrand. In view of (7.2. 10), it 
follows that 


E 
=f Bod=i (7.2.11) 
2 J-00 


Therefore, gr (t) must be appropriately scaled so that (7.2.8) and (7.2.11) are satisfied. 
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7.2.1 Demodulation of PAM Signals 


The demodulation of a bandpass digital PAM signal may be accomplished in one of several 
ways by means of correlation or matched filtering. For illustrative purposes we consider a 
correlation-type demodulator. 

The received signal may be expressed as 


r(t) = Amar (t) cos 2m fet + n(t) (7.2.12) 


where n(f) is a bandpass noise process, which is represented as 


n(t) =n (t) cos 2a fet — ny (t) sin 2a fet (7.2.13) 
and where ,.(¢) and n, (t) are the quadrature components of the noise. By cross correlating 
the received signal r(t) with w(t) given by (7.2.6), as shown in Figure 7.5, we obtain the 
output 


f rity) dt = Am +N = Sm +n (7.2.14) 
-%0 


where n represents the additive noise component at the output of the correlator. 
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Figure 7.5: Demodulation of bandpass digital PAM signal. 
The noise component has a zero mean. Its variance can be expressed as 


& 
oR -f POPP SAN) af (7.2.15) 
00 


where W(f) is the Fourier transform of y(t) and §,(f) is the power spectral density of the 
additive noise. The Fourier transform of y(t) is 
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WA) = FIGS = f+ Or + fol (7.2.16) 


and the power spectral density of the bandpass additive noise process is 


No i<W 
sipa=ta: TAAS (72.17) 


0, otherwise 


By substituting (7.2.16) and (7.2.17) into (7.2.15) and evaluating the integral, we obtain 
a; = Np/2. 

{tis apparent from (7.2.14), which is the input to the amplitude detector, that the prob- 
ability of error of the optimum detector for the carrier-modulated PAM signal is identical 
to that of baseband PAM. That is, 


Mu = 


2M —1) e( epte) (72.18) 


M (M? — 1)No 


where Eav is the average energy per bit. 
ILLUSTRATIVE PROBLEM 





Mlustrative Problem 7.1 In an amplitude-modulated digital PAM system, the transmitter 
filter with impulse response g7 (7) has a square-root raised-cosine spectral characteristic as 
described in Illustrative Problem 6.7, with a roll-off factor œ = 0.5. The cartier frequency 
is fe = 40/T. Evaluate and graph the spectrum of the baseband signal and the spectrum 
of the amplitude-modulated signal. 


fem SOLUTION fa 


Figure 7.6 illustrates these two spectral characteristics. The MATLAB script for this 
computation is given below. 











% MATLAB script for Ilustrated Problem 1. Chapter 7. 
echo on 


% sampling interval 
% roll-off factor 
% 


carrier frequency 





m=; % amplitude 
—5aT+deltaT:deltaT:5*T; % time axis 








Nelength(t); 
for i=1:N, 
if (abs(t(i))"=T/(2+alpha)), 
g.T(i) = sine(t¢i}/T)«(cos(pixalphast(i)/T)/(1—4«alpha *2«t(i)*2/T*2)); 


else 
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g-Ti) = 0; % the value of gT is O att = T/(2xalpha} 


end: % and, at 1 = -T/2ealpha) 

ead: 

G_T=abs(fft(g_T)); % spectrum of gT 
u_msA_mag.T.*cost2epixfeat): % the modulated signal 

U_mz=abs( fft(u.m)); % spectrum of the modulated signal 


Fo actual frequency scale 

f=—0.5/delta_T:1 /(delta_T#(N—1)):0.5/delta_T; 
% plotting commands follow 

figure(1); 

plot(f.fftshift(G_T), 

axis({—1/T 1/T 0 max(G_T))): 

figure(2); 

plot f.fftshift(U_m)); 

















Figure 7.6: Spectra of baseband signal and amplitude-modulated (bandpass) signal. 


7.3 Carrier-Phase Modulation 


In carrier-phase modulation the information that is transmitted over a communication chan- 
nel is impressed on the phase of the cartier, Since the tange of the carrier phase is 
0 < @ < 2x, the carrier phases used to transmit digital information via digital-phase 
modulation are 6, = 27m/M, for m = 0,1, M — 1. Thus, for binary phase mod- 
ulation (M = 2), the two carier phases are 6) = O and 0; = x rad. For M-ary phase 
modulation, M = 2*, where k is the number of information bits per transmitted symbol, 
The general representation of a set of M carcier-phase-modulated signal waveforms is 





2r 
m(t) = Agr (t) cos (orfa + zn), m=0,1,...,M = 1 03) 


where gr (t) is the transmitting filter pulse shape, which determines the spectral character- 
istics of the transmitted signal and A is the signal amplitude. This type of digital phase 


288 CHAPTER 7. DIGITAL TRANSMISSION VIA CARRIER MODULATION 


modulation is called phase-shift keying (PSK). We note that PSK signals have equal energy, 
1€., 


Ene f u} (t)dt 73.2) 
=% 
oO g 2 2m 
= | A*g7 (1) cos” (orra F zm) dt 
bags M 
Lf a5 Lf > 35 ., 4am 
=- vendre: | Agp lE) cos | 4a fet + ——— ) dr 
2 f ER E A M 
Are, 
= gpitydt (7.3.3) 
2 J- 
=£, for all m (7.3.4) 


where £, denotes the energy per transmitted symbol. The term involving the double- 
frequency component in (7.3.4) averages out to zero when fe >> W, where W is the 
bandwidth of gr (t). 

When gr(t) is a rectangular pulse, it is defined as 


zru = i O<r<T (7.3.5) 


In this case, the transmitted signal waveforms in the symbol interval 0 < t < T may be 
expressed as (with A = /£;) 


TE, 2 
unt) = y E cos (2na + HE), m=0,1,....M-1 (73.6) 


Note that the transmitted signals given by (7.3.6) have a constant envelope, and the carrier 
phase changes abruptly at the beginning of each signal interval. Figure 7.7 illustrates a 
four-phase (M = 4) PSK signal waveform. 

By viewing the angle of the cosine function in (7.3.6) as the sum of two angles, we may 
express the waveforms in (7.3.1) as 





2: . {2nm\ . 
um(t) = JE; grit) cos (7) cos 2x fot — VE, gr(t) sin ( ah ) sin 2a fat 
= Sme Wi (E) + Sms W2 (t) 73.7) 
where 

2xm 
Sme = y Es COS M. 
_ 2am 

Sms = ¥ Es sin M (7.3.8) 
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Figure 7.7: Example of a four-phase PSK signal. 


and w(t) and w2(r) are orthogonal basis functions defined as 


Wilt) = grl) cos afr 
Ya) = =gr (t) sin 2a fet (73.9) 


By appropriately normalizing the pulse shape gy (r), the energy of these two basis functions 
is normalized to unity. Thus, a phase-modulated signat may be viewed as two quadrature 
carriers with amplitudes that depend on the transmitted phase in each signal interval. Hence, 
digital phase-modulated signals are represented geometrically as two-dimensional vectors 
with COMpONENtS Sme aNd Sms. 


5m = (JE, cos 4# JE, sin 4#) (7.3.10) 


Signal point constellations for M=2, 4, and 8 are illustrated in Figure 7.8. We observe that 
binary phase modulation is identical to binary PAM (binary antipodal signals). 

The mapping, or assignment, of k information bits into the M = 2* possible phases 
may be done in a number of ways. The preferred assignment is to use Gray encoding, in 
which adjacent phases differ by one binary digit. as illustrated in Figure 7.8. Consequently, 
only a single bit error occurs in the k-bit sequence with Gray encoding when noise causes 
the erroneous selection of an adjacent phase to the transmitted phase. 


ILLUSTRATIVE PROBLEM 


Iilustrative Problem 7.2 Generate the constant-envelope PSK signal waveforms given by 
(1.3.4) for M = 8. For convenience, the signal amplitude is normalized to unity. 
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M=4 


Figure 7.8: PSK signal constellations. 


em SOLUTION — 


Figure 7.9 illustrates the eight waveforms for the case in which fe = 6/T. The MAT- 
LAB script for this computation is given below. 








% MATLAB script for Illustrative Problem 2, Chapter 7. 
echo on 


% carrier frequency 
% number uf samples 





t=O:delta_T:T; 
it 24Es /T)xcos(2epinfcst); 







t(2sBs/T)xcos(2spixfest+2epi/M); 
(2s /T)«cos(2+pixfcat+4epi/M): 
1t(24Es/T)*cos(2epixlcat+6xpi/M); 
=sqtt(2+Es/T)*cos(2upisfcxt+8xpi/M); 
It(2+Es/T)xcos(2apisfcat+ 1 Oxpi/M); 
t(2#Es/T)xcos(2epiafcat+ 1 2#pi/M); 
oe =sqtt(2Es/T)acos(2epinfcatt 1 4epi/M): 
% plotting commands follow 
subplot(8,1,1); 

plot(t,u0); 

subplot(8, 1,2); 

plot(tul); 

subplot(8, 1.3); 

plot(t,u2); 

subplot(8,1,4); 

plot(t,u3); 

subplot(8,1,5); 

plos(t.u4); 

subplot(8,1,6); 


rT ee en ge 
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plot(t,u5); 
subpiot(8,1.7); 
plot(t,u6); 
subplot(8,1,8); 
plotit.u7): 
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Figure 7.9: M = 8 constant-amplitude PSK waveforms. 


7.3.1 Phase Demodulation and Detection 


The received bandpass signal in a signaling interval from an AWGN channe! may be ex- 
pressed as 


r(t) = um(t) + n(t) 


Um{t) + no(t) cos 2m fet — ns (t) sin 27 fot (7.3.11) 


where n,(t) and n,(t) are the two quadrature components of the additive noise. 
The received signal may be correlated with y(t) and w(t) given by (7.3.9). The 


outputs of the two correlators yield the noise-corrupted signal components, which may be 
expressed as 
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F =Sm tn 


= (VE; cos 2% +n, JE, sin HM + n,) aaay 





where ne and n, are defined as 


tse 
Ne = sf gr(Ðnelt) dt 
=% 


poe 
5 J er (tny(tydt (7.3.13) 
00 


The quadrature noise components ne{t) and n,(r) are zero-mean Gaussian random 
processes that are uncorrelated. As a consequence, B(n,-) = E(ny) = 0 and E(nens) = 0. 
The variance of ne and ny is 


No 
E(n2) = En) = z (7.3.14) 

The optimum detector projects the received signal vector r onto each of the M possible 
transmitted signal vectors {sm} and selects the vector corresponding to the largest projection. 
Thus, we obtain the correlation metrics 


Clr. Sm) =F - Sm, m=0,1,....M@-1 (7.3.15) 


Because all signals have equal energy, an equivalent detector metric for digital phase mod- 
ulation is to compute the phase of the received signal vector r = (r1, 72) as 


6, = tan“! 2 (73.16) 
rl 


and select the signal from the set {Sm } whose phase is closest to 8+. 

The probability of error at the detector for phase modulation in an AWGN channel may 
be found in any textbook that treats digital communications. Since binary phase modulation 
is identical to binary PAM, the probability of error is 


P= ( fz) (73.17) 


where Ep is the energy per bit. Four-phase modulation may be viewed as two binary phase- 
modulation systems on quadrature (orthogonal) carriers. Consequently, the probability of 
a bit error is identical to that for binary phase modulation. For M > 4, there is no simple 
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closed-form expression for the probability of a symbol error. A good approximation for 
Py is 





a 
ss 2kEh m 
x e(j x on) (7.3.18) 


where k = log, M bits per symbol. Figure 7.10 ijlustrates the symbol error probability as 
a function of the SNR £,/No. 


P, probability of error 
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Figure 7.10: Probability of a symbol error for M-ary PSK. 


The equivalent bit-error probability for M-ary phase modulation is also difficult to 
derive due to the dependence of the mapping of k-bit symbols into the corresponding signal 
phases. When a Gray code is used in the mapping, two k-bit symbols corresponding to 
adjacent signal phases differ in only a single bit. Because the most probable errors due to 
noise result in the erroneous selection of an adjacent phase to the true phase, most k-bit 
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symbol errors contain only a single bit error. Hence, the equivalent bit-error probability for 
M-ary phase modulation is well approximated as 


P, — Py (7.3.19) 


LUSTRATIVE PROBLEM 


Illustrative Problem 7.3 We shall perform a Monte Carlo simulation of an M = 4 PSK 
communication system that models the detector as the one that computes the correlation 
metrics given in (7.3.15). The model for the system to be simulated is shown in Figure 
TAL. 











Uniform random 
number generator Gaussian RNG 


















Detector 2-bit symbol 














Gaussian RNG 












Bit-error Symbol-error 
counter counter 











Figure 7.11: Block diagram of an M = 4 PSK system for a Monte Carlo simulation. 


E 


As shown, we simulate the generation of the random vector r given by (7.3.12), which 
is the output of the signal correlator and the input to the detector. We begin by generating a 
sequence of quaternary (2-bit) symbols that are mapped into the corresponding four-phase 
signal points, as shown in Figure 7.8 for M = 4. To accomplish this task, we use a random 
number generator that generates a uniform random number in the range (0,1). This range is 
subdivided into four equal intervals, (0,0.25), (0.25,0.5), (0.5,0.75), and (0.75,1.0), where 
the subintervals correspond to the pairs of information bits 00, 01, 11, 10, respectively. 
These pairs of bits are used to select the signal phase vector Sm. 
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The additive noise components n; and n, are statistically independent zero-mean Gaus- 
sian random variables with variance ø?, For convenience, we may normalize the variance 
too? = | and control the SNR in the received signal by scaling the signal energy parameter 
£,, or vice-versa. 

The detector observes the received signal vector r = Sm + n as given in (7.3.12) and 
computes the projection (dot product) of r onto the four possible signal vectors Sm. Its 
decision is based on selecting the signal point corresponding in the largest projection, The 
output decisions from the detector are compared with the transmitted symbols, and symbol 
errors and bit errors are counted, 

Figure 7.12 illustrates the results of the Monte Carlo simulation for the transmission of 
N=10,000 symbols at different values of the SNR parameter £}/No, where Ep = £,/2 
is the bit energy. Also shown in Figure 7.12 is the bit-error rate, which is defined as 
Py ~ Py /2, and the corresponding theoretical error probability, given by (7.3.18). 

The MATLAB scripts for this Monte Carlo simulation are given below. 








Jo MATLAB script for Illustrative Problem 3, Chapter 7. 
echo on 
SNRindB1=0:2:10; 
SNRindB2=0:0.1:10; 
for i=1:length(SNRindB 1), 
-m_sm32(SNRindB Iti); % simututed bit and symbol error rates 
ert_prb(i)=pb, 
smld_symbolerr_prbi)=ps: 
end; 
for i= :length(SNRindB2), 
SNR=exp(SNRindB2(i}*log(10)/10): % signal-to-noise ratio 
theo_err_pro(i)=Qfunct(sqrt2*SNR});  % theoretical bit-error rate 
end: 
% Platting commands follow 
semilogy(SNRindBi smld_bit_ecr_prb,’ * ° ); 
hold 
semilogy(SNRindB | smid _symbol-err-prb. ' 0°); 
semilogy(SNRindB2,theo-err-prb); 


e 


function {pb,ps]=cm.sm32(snr_indB) 

% [pb.ps]=cm_sm32isnr in dB} 

% CM_SM32_ finds the probability of bit error and symbol error for the 
% given value of snrindB, signal-to-noise ratio in dB. 
N=10000; 

Est; % energy per symbol 
snr=107(snr_in-dB/10); % signal-to-noise ratio 
sgma=sqet(E/snr)/2; % noise variance 

% the signal mupping 

s00=[1 0); 

s0l=[0 1]; 

sil=(-1 0); 

sl0=[0 ~1]; 

% generation of the data source 
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for i=1:N, 
temp=rand; 
if (emp<0.25), 
dsource! (i)=0; 
dsource2(i)=0; 
elseif (temp<0.5), 
dsource 1 (1)=0; 
dsource?(i)=1; 
elseif (temp<0.75), 
dsource I(i)=1, 
dsource2(i)=O; 
else 
dsourcel(i)=1; 
dsource2(i)=1, 
end; 
end; 
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% a uniform rundom variable between O und I 


% 


h 


with probability 1/4, source output is 


with probability 1/4, source ouput is 


with probubility 1/4, source ouput is 


with probability 1/4, source ouput is 


% detection und the probability of error cateulation 


numofsymbolerror=0; 
nurnofbiterror=0; 
for i=1:N, 


% the received signal at the detector, for the ith symbol, is 


n(1)=gngauss(sgma); 

n(2)=gngauss(sgina), 

if ((dsource1(i)==0) 
r=s00+n; 


elseif ((dsource i(i)==0) & (dsource2(i 


rasOl¢n: 
elseif ((dsource (i): 
c=sl0+n, 
else 
rasi lan: 
end; 





& (dsource2(1)==0)), 





) & Wsource2()==0)), 


De 


% The correlation metrics are computed below 


c00=dor(r.s00); 
¢O1=dotir.s01); 
clO=dot(r,s10); 
elisdot(rsl)); 


% The decision on the ith symbol is made next 


c.max=max([e00 c0 





1 c10 cli}: 


elseif (cOl==c_max}, 








decisl=0; decis2=1; 

max), 

decis! decis2=0; 
else 


decisl=1, decis2= 


end; 


Ay 


% increment the error counter, if the decision is not correct 


symbolerror=0; 


if (decis1"=dsource | (i), 
numofbiterror=numofbiterror+1; 


symbolertor=1; 
end; 


if (decis2"=dsource2(i)), 
numofbiterror=numofbiterror+1; 





"90" 


“or” 


“o” 
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symbolerror=1; 
end; 
if (symbolerror==1), 
numofsymbolerror = numofsymbolerror+1; 


end; 

end; 

ps=numofsymbolerror/N % since there are totally N symbols 
pb=numofbiterror (2+); % since 2N bits are transmitted 
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Figure 7.12: Performance of a four-phase PSK system from the Monte Carlo simulation. 


7.3.2 Differential Phase Modulation and Demodulation 


The demodulation of the phase-modulated carrier signal, as described above, requires that 
the carrier phase components w(t) and W2(rt) be phase-locked to the received carrier- 
modulated signal. In general, this means that the receiver must estimate the carrier-phase 
offset of the received signal caused by a transmission delay through the channel and com- 
pensate for this carrier-phase offset in the cross correlation of the received signal with the 
two reference components y(t) and w2(t). The estimation of the carrier-phase offset is 
usually performed by use of a phase-locked loop (PLL). Thus, we achieve coherent phase 
demodulation. 

Another type of carrier-phase modulation is differential phase modulation, in which the 
transmitted data are differentially encoded prior to the modulator. In differential encoding, 
the information is conveyed by phase shifts relative to the previous signal interval. For 
example, in binary phase modulation the information bit 1 may be transmitted by shifting 
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the phase of the carrier by 180° relative to the previous carrier phase, whereas the information 
bit 0 is transmitted by a zero-phase shift relative to the phase in the preceding signaling 
interval. In four-phase modulation, the relative phase shifts between successive intervals 
are 0°, 90°, 180°, and 270°, corresponding to the information bits 00, 01, 11, and 10, 
respectively. The generalization of differential encoding for M > 4 is straightforward. 
The phase-modulated signals resulting from this encoding process are called differentially 
encoded, The encoding is performed by a relatively simple logic circuit preceding the 
modulator, 

Demodulation and detection of the differentially encoded phase-modulated signal may 
be performed as follows. The received signal phase # = tan7! r2/r, at the detector is 
mapped into one of the M possible transmitted signal phases {m} that is closest to 6. 
Following the detector is a relatively simple phase comparator that compares the phases of 
the detected signal over two consecutive intervals to extract the transmitted information. 

We observe that the demodulation of a differentially encoded phase-modulated signal 
does not require the estimation of the cartier phase. To elaborate, suppose that we demod- 
ulate the differentially encoded signal by cross correlating r(t) with gr (t) cos 2x fet and 
—aer(t)sin2rf.t, At the kth signaling interval, the two components of the demodulator 
output may be represented in complex-valued form as 


ry = JE eiA 4 ny (7.3.20) 


where 6, is the phase angle of the transmitted signal at the kth signaling interval, ¢ is the 
carrier phase, and ny = ng, + jigs is the noise. Similarly, the received signal vector at 
the output of the demodulator in the preceding signaling interval is the complex-valued 
quantity 





nos FIO tng | (73.20 


The decision variable for the phase detector is the phase difference between these two 
complex numbers. Equivalently, we can project rg onto rz_; and use the phase of the 
resulting complex number; that is, 


rtf, = Ege 4, SE IO, y t (Ee IG O n nn (7.3.22) 


which, in the absence of noise, yields the phase difference 9% — 8—1. Thus, the mean value 
of ryr{_, is independent of the carrier phase. Differentially encoded PSK signaling that 
is demodulated and detected as described above is called differential PSK (DPSK). The 
demodulation and detection of DPSK is illustrated in Figure 7.13. 

The probability of error for DPSK in an AWGN channel is relatively simple to derive 
for binary (M = 2) phase modulation. The result is 


P= zeam (1.3.23) 
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Figure 7.13: Block diagram of DPSK demodulator. 


The graph of (7.3.23) is shown in Figure 7.14. Also shown in this figure is the probability 
of error for binary PSK. We observe that at error probabilities below 1074, the difference 
in SNR between binary PSK and binary DPSK is less than | dB. 

For M > 2, the error probability performance of a DPSK demodulator and detector is 
extremely difficult to evaluate exactly. The major difficulty is encountered in the determi- 
nation of the probability density function for the phase of the random variable rrp given 
by (7.3.22). However, an approximation to the performance of DPSK is easily obtained, as 
we now demonstrate. 

Without loss of generality, suppose the phase difference & —6,; = 0. Furthermore, the 
exponential factors e~/(-1-#) and e/(-9) in (7.3.22) can be absorbed into the Gaussian 
Noise components m4; and ng without changing their statistical properties. Therefore, 
Farg, in (7.3.22) can be expressed as 


Trk- = Es + VEs (my +n) +n (7.3.24) 


The complication in determining the probability density function of the phase is the term 
n,ny_,. However, at SNRs of practical interest, the term nny is small relative to the 


dominant noise term V£; (n, +n{_,). If we negiect the term nni and we also normalize 
Targ, by dividing through by /Z;, the new set of decision metrics becomes 


= VE; + Re(ny +a) 
y = Im(n; + 7j_)) (7.3.25) 


The variables x and y are uncorrelated Gaussian random variables with identical variances 
a} = No. The phase is 
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Figure 7.14: Probability of error for binary PSK and DPSK. 
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ð, = tan! = (7.3.26) 
Atthis stage we have a problem that is identical to the one for phase-coherent demodulation. 
The only difference is that the noise variance is now twice as large as in the case of PSK. 
Thus we conclude that the performance of DPSK is 3 dB poorer than that for PSK. This 
result is relatively good for M > 4, but it is pessimistic for M = 2 in the sense that the loss 
in binary DPSK relative to binary PSK is less than 3 dB at large SNR. 


ILLUSTRATIVE PROBLEM 


INustrative Problem 7.4 Implement a differential encoder for the case of M = 8 DPSK. 


aL» —-—$@£@—_H_— 


The signal points are the same as those for PSK shown in Figure 7.8. However, for 
DPSK these signal points represent the phase change relative to the phase of the previous 
transmitted signal points. The MATLAB script for implementing the differential encoder 
is given below. 


kh —————_—_ —-—— 


% MATLAB script for Hlustrative Problem 4, Chapter 7. 
mapping={0 13 27 6 4 5); 





% For Gray mapping 


M=8; 

E=1; 

sequence=[0 10 0114 OO + 141 110 000} 

[e]=cm-dpske(E.M, mapping, sequence), % e is the differential encoder output 





ILLUSTRATIVE PROBLEM 


Illustrative Problem 7.5 Perform a Monte Carlo simulation of an M = 4 DPSK commu- 
nication system, The model for the system to be simulated is shown in Figure 7.15. 


SOLU ON 


The uniform random number generator (RNG) is used to generate the pairs of bits 
{00, 01, 11, 10}, as described in Illustrative Problem 7,3. Each 2-bit symbol is mapped into 
one of the four signal points Sm = [cosmm/2  sinam/2], m = 0, 1, 2,3, by the differ- 
ential encoder. Two Gaussian RNG are used to generate the noise components [ne ns]. 
Then, the received signal plus noise vector is 


r= [cos +n, sins +a] 
= [re rs] 


The differential detector basically computes the phase difference between rg and rg-i. 
Mathematically, this computation can be performed as in (7.3.22), i.e., 
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Figure 7.15: Block diagram of M = 4 DPSK system for the Monte Carlo simulation. 


Tarka = (Fek + Ftsk rok > jrsk~1) 
= Feklek-i Fekkai tT seh Pek sk-1) 
= uE+ I Ye 


and & = tan~!(y,/x,) is the phase difference. The value of 8 is compared with the 
possible phase differences {0°, 90°, 180°, 270°}, and a decision is made in favor of the 
phase that is closest to 6,. The detected phase is then mapped into the pair of information 
bits. The error counter counts the symbol errors in the detected sequence. 

Figure 7.16 illustrates the results of the Monte Carlo simulation for the transmission of 
N=10,000 symbols at different values of the SNR parameter £,/No, where £p = £,/2 is 
the bit energy. Also shown in Figure 7.16 is the theoretical value of the symbol error cate 
based on the approximation that the term n,nf_, is negligible. We observe from Figure 7.16 
that the approximation results in an upper bound to the error probability. The MATLAB 
scripts for this Monte Carlo simulation are given below. 





% MATLAB script for Hlustrative Problem 5, Chapter 7. 
echo on 

SNRindB 1=0:2:12; 

SNRindB2=0:0.1:12; 

for i=1:length(SNRindB 1), 
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smid_err_prb(i)=cm_sin34(SNRindB Ii): % simulated error rate 





end; 
for i=1-length(SNRindB2), 

SNR=exp(SNRindB2(i)+log(40}/10), Ge signul-w-noise ratio 

theo .err_prb(i}=2«Qfunct(sqr(SNR)); % theoretical symbol-errar rate 
end; 


% Plotting commands follow 
semilogy(SNRindB I smid_err_prb,’ +“): 
hold 

semilogy(SNRindB2.theo.err_prb); 


-o 


function [p]=cm_sm34(snr_in_4B) 
% {pj=cm_sm34{(snrin_dB} 














% CM_SM34 finds the probability of error for the given 
% value of snrinaB, signal-to-noise ratio in dB. 
N=10000; 
Est, % energy per symbol 
Snr=10°(snr_in.dB/10); % signal-to-noise ratio 
sgmazsqn(E/(4«snc)); % noise vuriunce 
% generation of the data source follows 
for i=1:2eN, 
temp=rand: % a uniform random variable between O and i 
if (temp<0.5), 
dsource(i)=0; % with probability 1/2, source output is “0” 
else 
dsource(i}=1; % with probability 1/2, source output is “1” 
end; 


end; 
% Differential encoding of the data source follaws 
mapping=[0 1 3 2); 
M=4; 
{diff-enc_output] = cm_dpske(E,M.mapping.dsource); 
% received signal is then 
for i=1:N, 
{n(1) n(2)J=gngauss(sgma); 
f(i,:)=diff_enc_outputti,)+n, 
end; 
% detection and the probability of error calculation 
numoferr=0; 





delta_theta=mod(theta~prev.theta,2+pi); 
if ((delta_theta<pi/4) | (delta_theta>7*pi/4)), 
decis=[0 0); 
elseif (delta_theta<3«pi/4), 
decis=(0 1}: 
elseif (delta_theta<5xpi/4) 
decis={1 1]; 
else 
decis=[1 0]; 
end; 
prev.theta=theta; 
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% increase the error counter if the decision ts not correct 
if ((decis(1)"=dsource(2+i—1)) | (decis(2)"=dsource(2+i))), 
numoferr=numoferr+1; 
end; 
end; 
p=numoferr/N; 


aia 


function [enc-comp] = cm_dpske(,M,mapping, sequence); 
% jenccomp} = cmaipske(EM, mapping sequence) 











% CMDPSKE differentially encodes a sequence 

% E iv the uverage energy, M is the number of constellanon points 
% and mapping is the vector defining how the constellation points are 
% allocated, Finally, “sequence” is the uncoded binary data sequence 
k=log2(M); 

Nelength(sequence), 


% if N is not divisible by k, append zeros, so that it ts 
remaindersremiN,k); 
if (remainder”=0), 

for i=N+1:N+k remainder, 





sequence(i}=0, 
end, 


+k —remainder; 





% initially, assume that theta=0 


for jsii+k-1, 
index=2sindex +sequencet)); 
end; 


index=index+1: 
theta=mod(2*pi*mapping{index)/M-+theta,2«pi); 
enc_comp((i+k — 1)/k,1)=sqrt(E)«cos(theta); 
enc.comp((i+k — 1)/k,2)=sqrt(E)»sinttheta), 
end; 








7.4 Quadrature Amplitude Modulation 


A quadrature-amplitude-modulated (QAM) signal employs two quadrature carriers, 
cos 27 ft and sin 27 fet, each of which is modulated by an independent sequence of infor- 
mation bits, The transmitted signal waveforms have the form 


Un(t) = Amegr(t) cos 2 fet + Amsgr(t) sin 27 fot, m=1,2,...,M (7.4.1) 
where {Amc} and {Amy} are the sets of amplitude levels that are obtained by mapping k-bit 


sequences into signal amplitudes. For example, Figure 7.17 illustrates a 16-QAM signal 
constellation that is obtained by amplitude modulating each quadrature carrier by M = 4 
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Figure 7.16: Performance of four-phase DPSK system from Monte Carlo simulation (the 
solid curve is an upper bound based on approximation that neglects the noise term ny7 4). 





Figure 7.17: M = 16-QAM signal constellation. 
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PAM. In general, rectangular signal constellations result when two quadrature carriers are 
each modulated by PAM. 

More generally, QAM may be viewed as a form of combined digital amplitude and 
digital-phase modulation. Thus the transmitted QAM signal waveforms may be expressed 
as 


Umn(t) = Amar (t) cos(2r fet + On). m=1,2,...,M1, n=1,2,..., M2 
(7.4.2) 


IfM = 24, and My = 2%, the combined amplitude and phase-modulation method results 
in the simultaneous transmission of k; + kı = logyM,M2 binary digits occurring at a 
symbol rate Ry/(k, + k2). Figure 7.18 illustrates the functional block diagram of a QAM 
modulator. 
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Figure 7.18: Functional block diagram of modulator for QAM. 


It is clear that the geometric signal representation of the signals given by (7.4.1) and 
(7.4.2) is in terms of two-dimensional signal vectors of the form 


Sm = (VE; Ame SE; Ams), m=1,2,...,M (7.4.3) 
Examples of signal space constellations for QAM are shown in Figure 7.19. Note that 
M = 4 QAM is identical to M = 4 PSK. 
7.4.1 Demodulation and Detection of QAM 


Let us assume that a carrier-phase offset is introduced in the transmission of the signal 
through the channet. In addition, the received signal is corrupted by additive Gaussian 
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Figure 7.19: (a) Rectangular and (b),(c) circular QAM signal constellations. 


noise. Hence, r(7) may be expressed as 


rC) = Amegr (i) cos(2r fet + 0) + Ams@r (0) sin(2x fet +6) + A(t) (7.4.4) 


where ¢ is the carrier phase offset and 


n(t} = nelt} cos 2a fet — ns (t) sin 2a fet 


The received signal is correlated with the two phase-shifted basis functions 


Wilt) = gr(t)cos(27 fet + ¢) 

palt) = gr (t) sin(2rf.t +) (7.4.5) 
as illustrated in Figure 7.20, and the outputs of the correlators are sampled and passed 
to the detector. The phase-locked loop (PLL) shown in Figure 7.20 estimates the carrier 
phase offset of the received signal and compensates for this phase offset by phase shifting 
wilt) and w(t) as indicated in (7.4.5). The clock shown in Figure 7.20 is assumed to be 
synchronized to the received signal so that the correlator outputs are sampled at the proper 
instant in time. Under these conditions, the outputs from the two correlators are 


ri = Amc +c cosg — ny sing 
T2 = Ams +n, sing + n, coso (7.4.6) 
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where of being easily generated as two PAM signals impressed on phase quadrature carriers. In 
addition, they are easily demodulated. 
For rectangular signal constellations in which M = 2*, where k is even, the QAM signal 


T i } 
j- ne(yer(t)dt : constellation is equivalent to two PAM signals on quadrature carriers, each having V M = 


1 
meS 
2 i 2/? signal points. Because the signals in the phase quadrature components are perfectly 
2i T P ä | separated by coherent detection, the probability of error for QAM is easily determined from 
m=z j Oerd (14.7) | the probability of error for PAM. Specifically, the probability of a correct decision for the 


M-ary QAM system is 
The noise components are zero-mean, uncorrelated Gaussian random variables with vari- 











































































































ance No/2. 2 
P. = (1 Py) (7.49) 
| where P jz is the probability of error of a /M-ary PAM with one-half the average power 
in each quadrature signal of the equivalent QAM system. By appropriately modifying the 
= {Ode | Sampler probability of error for M-ary PAM, we obtain 
(AO 
i Pa=2(1--_)o 2 (7.4.10) 
æ Clock MES JM M—1 No A 
Received BLE H 
signal ai Compute Output where £3,/No is the average SNR per symbol. Therefore, the probability of a symbol error 
Blt. distance} Ur 4 2 
i t metrics Dens decision for the M-ary QAM is 
phase m 
shift f 
(1-P y (1.4.11) 
Py=t—-(l- 4. 
%) Vu 
ES We note that this result is exact for M = 2* when & is even. On the other hand, when k is 
+} God -| Sampler I odd, there is no equivalent M-ary PAM system. This is no problem, however, because 
it is rather easy to determine the error rate for a rectangular signal set. If we employ 
the optimum detector that bases its decisions on the optimum distance metrics given by 
(7.4.8 ), it is relatively straightforward to show that the symbol-error probability is tightly 
Figure 7.20: Demodulation and detection of QAM signals. upper-bounded as 
The optimum detector computes the distance metrics ETTE 2 
Py sl-|i1-20 3B wv 
MS. y (M — No 


Dr. sm) =F- Sm},  m=1.2,..., M (1.4.8) ae 
4 aia Le 7.4.1 
where r! = (r4, r2) and Sm is given by (7.4.3). <40 ( (M — 1)No ( 2) 


iii j for any k > 1, where Eqyp/No is the average SNR per bit. The probability of a symbol 
7.4.2 Probability of Error for QAM in an AWGN Channel error is plotted in Figure 7.21 as a function of the average SNR per bit. 


In this section, we consider the performance of QAM systems that employ rectangular 
signal constellations, Rectangular QAM signal constellations have the distinct advantage 
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Figure 7,21: Probability of a symbol error for QAM. 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 7.6 Perform a Monte Carlo simulation of an M = 16-QAM com- 


munication system using a rectangular signal constellation. The model of the system to be 
simulated is shown in Figure 7.22. 
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Figure 7.22: Block diagram of an M = 16-QAM system for the Monte Cario simulation. 


im SOLUTION 


The uniform random number generator (RNG) is used to generate the sequence of in- 
formation symbols corresponding to the 16 possible 4-bit combinations of bi, b2, b3, b4. 
The information symbols are mapped into the corresponding signal points, as illustrated in 
Figure 7.23, which have the coordinates { Amc, Ams]. Two Gaussian RNG are used to gen- 
erate the noise components [n,, ns]. The channel-phase shift ¢ is set to 0 for convenience, 
Consequently, the received signal-plus-noise vector is 





r= [Ame +n Ams +n] 


The detector computes the distance metrics given by (7.4.8) and decides in favor of the signal 
point that is closest to the received vector r. The error counter counts the symbol errors in 
the detected sequence. Figure 7.24 illustrates the results of the Monte Carlo simulation for 
the transmission of N=10,000 symbols at different values of the SNR parameter E,/No, 
where £p = £,/4 is the bit energy. Also shown in Figure 7.24 is the theoretical value of 


the symbol-error probability given by (7.4.10) and (7.4.11). The MATLAB scripts for this 
problem are given below. 
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— aia» 


% MATLAB script for Mlustrative Problem 6, Chapter 7. 














echo on 
SNRindB1=0:2:15; 
SNRindB2=0:0.1:15; 
M=18; 

k=log2(M); 


for i=1:length(SNRindB1), 
smid_ert_prb(i)=cm_sm41(SNRindBl(i)); % simulated error rate 

end, 

for ist length(SNRindB2), 
SNR=exp(SNRindB2(i)*log(10)/10); % signal-to-noise ratio 
% theoretical symbol error rate 
theo_err..prd(i}=4«Qfunct(sqrt(3#k *SNR/(M=1))): 

end; 

% Plotting commands follow 

semilogy(SNRindB I smid_err_prb,‘ * * ); 

hold 

semilogy(SNRindB2.theo_err_prb); 


mem MAILE 


function [p}=cm.sm41{snr_in.dB) 

% [p]=em_sm4l{snrin.dB) 

% CM_SM41 finds the probability of error for the given 
% value of snrin.dB, SNR in dB. 

0000; 















% min. distance between symbols 











Eav=10«d"2; % energy per symbol 

snr=107(snt-in.dB/10); % SNR per bit (given) 

sgmazsqrt(Eav /(Besnt)); % noise variance 

M=16; 

% generation of the data source follows 

for i=1:N, 
temp=rand; % a uniform RV. between 0 and È 
dsource(i)=1+floor(M temp), % a number between | and 16, uniform 


end, 

% Mapping w the signal constellation fallow 
mapping=[—3sd 3xd; 
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for i=t:N, 
qam_sig(i,:)=mapping(dsource(i).:): 
end; 
% received signal 
for i=1:N, 
[n(1) n(2)]=gngauss(szma), 
ri, =qam-sigti+n: 





end, 
% detection and error probability calculation 
numoferr=0; 
for i=1:N, 
% metric computation follow 
for j=1:M, 
metrics(j)=(r(1,1)—mapping(.1))” 2+(1(i,2)—mapping(j.2))°2; 
end; 


[min-metric decis} = min(metrics). 
if (decis"=dsource(i)) 
numoferr=numoferr+1; 
end; 
end; 
p=numoferr/(N); 





. .3b o . 
2 
. . ıb o» . 





Figure 7.23: M = 16-QAM signa! constellation for the Monte Carlo simulation. 


7.5 Carrier-Frequency Modulation 


Above, we described methods for transmitting digital information by modulating either the 
amplitude of the carrier, the phase of the carrier, or the combined amplitude and phase. 
Digital information can also be transmitted by modulating the frequency of the carrier, 

As we will observe from our treatment below, digital transmission by frequency mod- 
ulation is a modulation method that is appropriate for channels that lack the phase stability 
that is necessary to perform carrier-phase estimation. In contrast, the linear modulation 
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Figure 7.24: Performance of M = 16-QAM system from the Monte Carlo simulation. 


methods that we have introduced—namely, PAM, coherent PSK, and QAM—require the 
estimation of the carrier phase to perform phase-coherent detection. 


7.5.1 Frequency-Shift Keying 


The simplest form of frequency modulation is binary frequency-shift keying (FSK). In 
binary FSK we employ two different frequencies, say, fi and fz = fı + Af, to transmit 
a binary information sequence. The choice of frequency separation Af = fo — fi is 
considered below. Thus the two signal waveforms may be expressed as 


ui) = |E cos2mfit, O0<1<T 
Th 

ult) = [= costmfat, O<t<Th (7.5.1) 
h 


where £p is the signal energy per bit and 7} is the duration of the bit interval. 


More generally, M-ary FSK may be used to transmit a block of k = log M bits per 
signal waveform. In this case, the M signal waveforms may be expressed as 





_ 
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{2. 
F cos(2m fet + 2amAfrt), m=0,1,...,M—-1, O<:<T 
(7.5.2) 


um (t) 


where E, = k£p is the energy per symbol, T = kT) is the symbol interval, and Af is 
the frequency separation between successive frequencies, i.e, Af = fm — fn for all 
m=1,2,..., M — l, where fm = fe + mAf. 

Note that the M FSK waveforms have equal energy, £;. The frequency separation 
Af determines the degree to which we can discriminate among the M possible transmitted 
signals. As a measure of the similarity (or dissimilarity) between a pair of signal waveforms. 
we use the correlation coefficient ymn 





r 
f Umit) l(t) dt (7.5.3) 
o 


By substituting for m(t} and Um(t) in (7.5.3). we obtain 


tf? 22, 
Ymn = zÍ Pp EOsl2n fet + 2am ft) cos(2n fut +2anAft}di 
s J0 


LE a wept 
zÍ cos2r(m -nyafi di + f cos [47 fot +2r(m +n)Aft] dr 
0 0 


= sin2x(m —n)AfT 
~ 2a(m—=n)AfT G24) 


where the second integral vanishes when f, >> 1/T. A plot of Ymn as a function of the 
frequency separation Af is given in Figure 7.25, We observe that the signal waveforms 
are orthogonal when Af is a multiple of 1/27. Hence, the minimum frequency separation 
between successive frequencies for orthogonality is 1/27. We also note that the mini- 
mum value of the correlation coefficient is Yma = —0.217, which occurs at the frequency 
separation Af = 0.715/T . 

M-ary orthogonal FSK waveforms have a geometric representation as M M- 
dimensional orthogonal vectors, given as 


so = (SE, 0, ....0) (7.5.5) 
51 = (0, VE, 0, ...,0) (7.5.6) 

: (7.5.7) 

su-1 = (0,0,...,0, YEr) (7.5.8) 


where the basis functions are Ym(t) = /2/T cos 2n( fe + mAf)t. The distance between 
pairs of signal vectors isd = ./2£, for all m, n, which is also the minimum distance among 
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Figure 7.25: Cross correlation coefficient as a function of frequency separation for FSK 
signals. 


the M signals. Note that these signals are equivalent to the M-ary baseband orthogonal 
signals described in Section 5.4. 
The demodulation and detection of the M -ary FSK signals is considered next. 


7.5.2 Demodulation and Detection of FSK Signals 


Let us assume that the FSK signals are transmitted through an additive white Gaussian noise 
channel, Furthermore, we assume that each signal is delayed in the transmission through 
the channel. Consequently, the filtered received signa! at the input to the demodulator may 
be expressed as 





r(t) =\> cos(2mfct + ImmASt + bm) + a(t) (7.5.9) 


where $m denotes the phase shift of the mth signal (due to the transmission delay) and z(t) 
represents the additive bandpass noise, which may be expressed as 


n(t) = ne(t) cos 2m fet — ny(t) sin 27 fet (7.5.10) 


The demodulation and detection of the M FSK signals may be accomplished by one 
of two methods. One approach is to estimate the M carrier-phase shifts {Øm} and perform 
phase-coherent demodulation and detection. As an alternative method, the carrier phases 
may be ignored in the demodulation and detection. 

In phase-coherent demodulation, the received signal r (r) is correlated with each of the M 


possible received signals cos (2mfet +2nmAft+ dn): form =0,1,..., M — 1, where 
(bm) are the carrier-phase estimates. A block diagram illustrating this type of demodulation 
is shown in Figure 7.26. Itis interesting to note that when, # Êm form =0,1,...,M@—1 
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(imperfect phase estimates), the frequency separation required for signal orthogonality at 
the demodulator is Af = 1/7, which is twice the minimum separation for orthogonality 
when @ = @. 
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Figure 7.26: Phase-coherent demodulation of M-ary FSK signals. 


The requirement of estimating M carrier phases makes coherent demodulation of FSK 
signals extremely complex and impractical, especially when the number of signals is targe. 
Therefore, we shall not consider coherent detection of FSK signals. 

Instead we consider a method for demodulation and detection that does not require 
knowledge of the carrier phases. The demodulation may be accomplished as shown in Figure 
7.27. In this case there are two correlators per signal waveform, or a total of 2M correlators, 
in general. The received signal is correlated with the basis functions (quadrature carriers) 
Js cos(2x fet +2amAfr) and (3 in(2x fet +2amAft) form =0,1,...,4@—1. The 
2M outputs of the correlators are sampled at the end of the signal interval and are passed 


to the detector. Thus, if the mth signal is transmitted, the 2M samples at the detector may 
be expressed as 





ne = VE = — mysfT ree cos 2x(k — m)AfT —1t 


Ta(k—m)AfT “ Zak myAfT sin gn | + me 


cos 27 (k — m)AfT — 1 sin2a(k—m)AfT . 
PAR ad (cinta de a! pa A WAR td A 
fi j [ In(k=myafT °°" + Se my AST sing | Mk 


(7.5.11) 
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where nge and ngs denote the Gaussian noise components in the sampled outputs. 
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Figure 7.27: Demodulation of M-ary signals for noncoherent detection. 























We observe that when k = m, the sampled values to the detector are 


Ime = y Es COS bm + Mme 

Ims = V Es sind + nms (7.5.12) 
Furthermore, we observe that when k & m, the signal components in the samples rz, and 
rks will vanish, independent of the values of the phase shift ġx, provided that the frequency 
separation between successive frequencies is Af = 1/7. In such a case, the other 2(M — 1) 
correlator outputs consist of noise only, i.e., 


The = Mke, Tks = Mks, kém (7.5.13) 


In the following development we assume that Af = 1/T, so that the signals are orthogonal. 
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lt can be shown that the 2M noise samples {nkc}and {rke} are zero-mean, mutually 
uncorrelated Gaussian random variables with equal variance es No/2. Consequently, 
the joint probability density function for Ting and rms conditioned on Øm is 


1 


Sonme Yims | Om) = [irme -sE coson) + Uns = VE; sin bm)? 202? 
M: : 2 


(7.5.14) 





and form Æ k, we have 


(her? ye? 
Salke hy) = etie tri 20 





(7.5.15) 


2x07 


Given the 2M observed random variables (rees tes HES! the optimum detector selects 
the signal that corresponds to the maximum of the posterior probabilities. i.e., 


P [Sm was transmitted | r] = P(s |r), m=O0,1....,.M—1 (7.5.16) 


where r is the 24-dimensional vector with elements {Fhe Tks pole When the signals are 
equally probable, the optimum detector specitied by (7.5.16) computes the signal envelopes, 


defined as 
Im = Setri m=0,1,..., M>] (7.5.17) 


and selects the signal corresponding to the largest envelope of the set {rm}. In this case the 
optimum detector is called an envelope detector. 


An equivalent detector is one that computes the squared envelopes 


Teta kia makos MAI (7.5.18) 


and selects the signal corresponding to the largest, {3 }. In this case, the optimum detector 
is called a square-taw detector. 


ILLUSTRATIVE P 





LEM 





Hlustrative Problem 7.7 Consider a binary communication system that employs the two 
FSK signal waveforms given as 


u(i) = cos 2a fyt, Ostaa 
ua{t) = cos 27 fat, Ost<sTr 


where fı = 1000/7, and f2 = fı + 1/Tp. The channel imparts a phase shift of @ = 45° 
on each of the transmitted signals, so that the received signal in the absence of noise is 
HQ = cos (2nfit + =), i=1,2, O<t<%, 
7 Sts 


Numerically implement the correlation-type demodulator for the FSK signals. 
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em SOLUTION 


We sample the received signal r(t) at arate F; = 5000/ T, in the bit interval Tp. Thus 
the received signal r(t) is represented by the 5000 samples {r(n/F,)}. The correlation 
demodulator multiplies {r(/F,)} by the sampled version of a(t) = cos 2x fit, vi) = 
sin 27 fit, ualt) = cos 27 fat, and v(t) = sin 27 fat, as illustrated in Figure 7.27. Thus 
the correlator outputs are 





4 k=1,2,... ,5000 





. 5000 
n=0 
4 n n 

mk) = Jor zag) k=1,2,... ,5000 
a= 
z n n 

n= Er(Z)a(Z). k= 1,2,... ,5000 


The detector is a square-law detector that computes the two decision vartables 


rı = r7,(5000) + r7,(5000) 
r2 = r2,(5000) + r2, (5000) 


and selects the information bit corresponding to the larger decision variable. 

A MATLAB program that implements the correlations numerically is given below. The 
graphs of the correlator outputs are shown in Figure 7.28, based on the signal u,(r) being 
transmitted. 








% MATLAB script for Illustrative Problem 7, Chapter 7. 
echo on 





f2={1+1/Tb; 


phi=pi/4; 
% number of samples 





u2=cos(2epief2at); 

% ussuminy thut ul is transmitted, the received signal r ix 
sgma=1, % naise variance 
for i=1:N, 
Ti)=cos(2+pi+f #1(i)+phi)+gngauss(sgma); 
end: 

% the correlator outputs are computed next 
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vissin(2episfl <0: 
v2ssin(2epixf2xt); 


e(k—t)+r(k)aul(k)s 
stk—1#r(k ev lk); 
c(k— 1) +r(k) #u2(k); 
ras(k)sr2s(k~ ter(kdev2(k), 
end, 
% decision variables 
1¢(5000)* 2+r1s(5000)"2; 
2c(5000)° 2+12s(5000)* 2; 
% plotting commands follow 
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Figure 7.28: Output of correlators for binary FSK demodulation. 


7.5.3 Probability of Error for Noncoherent Detection of FSK 


The derivation of the performance of the optimum envelope detector for the M-ary FSK 
signals can be found in most texts on digital communication. The probability of a symbol 
error may be expressed as 





M-I if 1 
Py = > i aei ba —ak£y/Nointi) 
M al y a Jap (7.5.19) 
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When M = 2, this expression reduces to the probability of error for binary FSK, which is 


1 
h=; e- En/2No (7.5.20) 


For M > 2, the bit-error probability may be obtained from the symbol error probability 
by means of the relation 


2k- 
pam 

The bit-error probability is plotted in Figure 7.29 as a function of the SNR per bit 
for M = 2,4, 8, 16, 32. We observe that for any given bit-error probability, the SNR per 
bit decreases as M increases. In the limit as M — oo, the crror probability can be made 
arbitrarily small provided that the SNR per bit exceeds — 1.6 dB. This is the channel capacity 


limit, or Shannon limit, for any digital communication system transmitting information 
through an AWGN channel. 


P, = Pu (7.5.21) 
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Figure 7.29: Probability of a bit error for noncoherent detection of orthogonal FSK signals. 


The cost of increasing M is the bandwidth required to transmit the signals. Since the 
frequency separation between adjacent frequencies is Af = 1/T for signal orthogonality, 
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the bandwidth required for the M signals is W = M/T. The bit rate is R = k/T, where 
k = log) M. Therefore, the bit-rate-to-bandwidth ratio is 


R _ log,M 
w M 
We observe that R/W —> Oas M > 0. 


ILLUSTRATIVE PROBLEM 





(7.5.22) 





Mustrative Problem 7.8 Perform a Monte Carlo simulation of a binary FSK communica- 
tion system in which the signal waveforms are given by (7.5.1), where fz = fı +1/Tp and 


the detector is a square-law detector. The block diagram of the binary FSK system to be 
simulated is shown in Figure 7.30. 
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Figure 7.30: Block diagram of a binary FSK system for the Monte Carlo simulation. 


ED 


Since the signals are orthogonal, when u; (t) is transmitted, the first demodulator output 
is 


Tic = y Ep cosb+nic 
ris = VE, sing + nys 
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and the second demodulator output is 


where Mie, Ris, Azc, and no, are mutually statistically independent zero-mean Gaussian 
random variables with variance o? and ¢ represents the channel-phase shift. 

In the above expression, the channel-phase shift @ may be set to zero for convenience. 
The square-law detector computes 


n= ae + rè, 


nah +8, 


and selects the information bit corresponding to the larger of these two decision variables. 
An error counter measures the error rate by comparing the transmitted sequence to the 
output of the detector. 

The MATLAB programs that implement the Monte Carlo simulation are given below. 
Figure 7.31 illustrates the measured error rate and compares it with the theoretical error 
probability given by (7.5.20). 








% MATLAB script for Hlustrative Problem 8. Chapter 7. 
echo on 
SNRindB1=0:2:15, 
SNRindB2=0:0.1:15; 
for i=1:length(SNRind8 1), 
smid_err_protijzcm_smS2(SNRindBi{i)}; F% simulated error rate 





end: 
for i=1:length(SNRindB2), 
SNR=exp(SNRindB2(i)*log(10)/10); % signal-to-noise ratio 
theo-err_prb(i}=(1/2)*exp(~SNR/2), % theoretical symbol error rate 
end: 


% Plotting commands follow 
semilogy(SNRindB | smld_err_prb,’**}: 
hold 
semilogy(SNRindB2,theo.err_prb); 


e 


function {pj=cm-sm52(snr-in-dB) 

% {pl=cm-sm52(snr in-dB}) 

% CM-SM52 Returns the probability of error for the given 
value of snr-indB, signal-to-noise ratio in dB. 











% 
N=10000; 





d=1; 
snr=10*(snr_in_dB/10}; 


% signal-to-noise ratio per bit 
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sgma=sqmt{Eb/{2asne)): % noise variance 
phi=0: 
% generation of the data source follows 
for i=1:N, 
temp=rand; % a uniform random variable berween 0 and d 


if (temp<0.5), 





dsourceti)=1;, 
end; 
end: 
% detection und the probability of error calculation 
numoferr=0, 
for i=1:N, 
% demodulator output 
if (dsource(ij==0), 
rOc=sqn(Eb)+cos( phi) +gngauss(sgma). 
rOs=sqrt(Eb)ssin(phi)+gngauss(sgma); 
rlc=gngauss(sgma): 
rls=gngauss(sgma): 
else 
rOc=gngauss(sgma); 
rOs=gngauss(sgma); 
rlc=sqrt(Eb)«cos(phi)+gngauss(sgma); 
12c=sqrt(Eb)ssin( phi)+gngauss(sgma), 
end; 
% square law detector outputs 
rc *2+r0s*2;, 
rl=rle*2+r1s72; 
% decision is made next 
if (0>rl), 
decis=0; 
else 
decis=1, 
end: 
% increment the error counter if the decision is not correct 
if (decis“=dsource(i)), 
numoferr=numoferr+1; 
end; 
end: 
p=numoferr/(N): 











7.6 Synchronization in Communication Systems 


In Section 3.3 we described the demodulation process for AM signals. In particular we 
showed that we can classify the demodulation schemes into coherent and noncoherent 
schemes. In coherent demodulation, the AM signal is multiplied by a sinusoid with the same 
frequency and phase of the carrier and then demodulated. In noncoherent demodulation, 
which can be applied only to the conventional AM scheme, envelope demodulation is 
employed and there is no need for precise tracking of the phase and the frequency of the 
carrier at the receiver. We furthermore showed in Illustrative Problem 3.6 that correct 
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Figure 7.31: Performance of a binary FSK system from the Monte Carlo simulation. 


phase synchronization in coherent demodulation is essential, and phase errors can result in 
considerable performance degradation. 

In this chapter we discussed the demodulation schemes for digital carrier-modulated 
systems. In the demodulation of PAM, PSK, and QAM, we assumed that we have complete 
knowledge of the carrier frequency and phase. 

In this section we discuss methods to generate sinusoids with the same frequency and 
phase of the carrier at the demodulator. These methods are studied under the title of 
carrier synchronization and apply to both analog and digital carrier modulation systems 
discussed in this chapter and Chapter 3. Another type of synchronization, called timing 
synchronization, clock synchronization, or timing recovery, is encountered only in digital 
communication systems, We briefly discuss this type of synchronization problem in this 
section as well, 


7.6.1 Carrier Synchronization 


A carrier-synchronization system consists of a local oscillator whose phase is controlled 
to be in synch with the carrier signal. This is achieved by employing a phase-locked loop 
(PLL). A phase-locked loop is a nonlinear feedback-control system for controlling the phase 
of the local oscillator. In the following discussion, for simplicity we consider only binary 
PSK modulation systems. 


The PLL is driven by a sinusoidal signal at carrier frequency (or a multiple of it). In 
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order to obtain the sinusoidal signal to drive the PLL, the DSB-modulated signal 


u(t) = Acm{t) cos{(27 fyt ~ (rt) (7.6.1) 


where m(t) = £1 is squared to obtain 


w(t) = Am? (t) cos? (2x fot — $(t)) 


A? 3 
c2 A a š: 
zmo + sr) cos(4r fot — 26(t)) 


2 


ZA 
= z + > cos(4ir fet — 26(¢)) (7.6.2) 


Obviously, this signal has a component at 2 fe. The reason that we do not deal directly with 
u(t) is that usually the process m(r) is zero-mean, so the power content of u(t) at fo is zero. 
Now, if the signal u(r) is passed through a bandpass filter tuned to 2f,, the output will be 
a sinusoidal signal with the central frequency 2 fy, a phase of —2¢ (t), and an amplitude of 
AZH(2f.)/2. Without loss of generality we can assume that the amplitude is unity; i.e., 
the input to the PLL is 


r(t) = cos(4x fat — 26(1)) (7.6.3) 


The PLL consists of a multiplier, a loop filter, anda voltage-controlled oscillator (VCO), 
as shown in Figure 7.32. if we assume that the output of the VCO is sin(4x fet ~ 20(t)), 





input signal 
r(t) 


e(t) 





Loop Filter 








sin(4x f-t + 26) 








vco Lv) | 











Figure 7.32: The phase-locked loop. 


then at the input of the loop filter we have 


e(t) = cos(4r fet — 26(t)) sin{4z fot ~ 26(t)) 


1 a a 
3 sin(26(t) — 26(t)) + SBa fer ~ 2b(t) — 26(t)) (7.6.4) 


Note that e(t) has a high- and a low-frequency component. The role of the loop filter is 
to remove the high-frequency component and to make sure that $C) follows closely the 


29(t) 
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variations in ¢ (z). A simple loop filter is a first-order lowpass filter with a transfer function 
of 


I+ 5 


Go) = 
©) 1+ ns 


(7.6.5) 
where r >> 1). If we denote the input of the VCO as u(t), then the output of the VCO will 
be a sinusoid whose instantancous frequency deviation from 2 f, is proportional to u(t). 


But the instantaneous frequency of the VCO output is 


ld, 
2fe + = Ot) 


xdt 
therefore 
d. K 
qo = een) (7.6.6) 
or, equivalently, 
i 
2$) = xf v(t)dt (7.6.7) 
-%0 


where K is some proportionality constant. After removal of the second and fourth harmon- 
ics, the PLL reduces to the one shown in Figure 7.33. 









$ sin(2ġ (1) — 290) 


















YCO 
2$) = K feo Vidt 





Figure 7.33: The phase-locked loop after removal of high-frequency components. 


Assuming that o) closely follows changes in (t), the difference 2¢(t) — 2$) is 
very small, and we can use the approximation 


sin (200 = 28) © 6) - 0) (76.8) 


With this approximation the only nonlinear component in Figure 7.33 is replaced by a 
linear component, resulting in the linearized PLL model shown in Figure 7.34. Note that 
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Figure 7.34; The linearized model for a phase-locked loop. 


this model is represented in the transform domain, and the integrator is replaced by its 
transform domain equivalent, 1/s. 

The model shown in Figure 7.34 is a linear control system with a forward gain of G(s) 
and a feedback gain of K /s; therefore, the transfer function of the system is given by 


G(s) __ KG(s)/s 





Ks) = — = — 
O = S6) = TFEGOA ree) 
and with the first-order model for G{s) assumed before, 
1 
Gis) = -Eu (7.6.10) 
1+ ts 
H(s) is given as 
t 
Hoane EE ee 61D 


1+ (tpt 1/K)s+ s?/K 
With H(s) as the transfer function, if the input to the PLL is ®{s), the error will be 
AVMs) = O(s) — $65) 
= O(s) — O(s) H(s) 
(1 - H()] 6) 
(1+ rs)s 


Sirak ra (7.6.12) 


Now let us assume that up to a certain time ¢(1) © dt), so A(t) = 0. At this time 
some abrupt change causes a jump in ġ (t) that can be modeled as a step; i.e., P(s) = K/s. 
With this change we have 


(1+ t25)s Ki 

AO(s) = —————_ 

ts) K+(1+Ku)s+ts* s 
Ky (1+ ts) 


“K++ Ky)s + ns? (7.6.13) 
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Now, by using the final value theorem of the Laplace transform, which states that 
lim f(t} = lim s F(s) (7.6.14) 
I-00 s>0 
as long as all poles of s F(s) have negative real parts, we conclude that 


lim Ag(t) = lim s®(s) 
100 sd 


Ape Kys(1+ ms) 
~ y0K + (14+ Kti)s + 1252 
=0 (7.6.15) 


In other words, a simple first-order loop filter results in a PLL that can track jumps in the 
input phase. 

The transfer function (7.6.11) can be written in the standard form 
_ (26, — @2/K)s +o? 


H 
e s? + ons + w2 


(7.6.16) 


Here, 


wnr = VK/ 
_ Ont + 1/K} 
ig 2 


where wp» is the natural frequency and ¢ is the damping factor. 
ILLUSTRATIVE PROBLEM 
Illustrative Problem 7.9 [First-order PLL] Assuming that 


1+0.01s 
G6) = 
© tts 


and K = 1, determine and plot the response of the PLL to an abrupt change of height 1 to 
the input phase. 


$$ _______________ 


Here r; = 0.01 and tz = l; therefore, 
On =1 
¢ = 0,505 

which results in 

0.0ls + 1 
s?+ 101s +1 
Thus the response to Ø (t) = u(t)—i.e., O(s) = 1/s—is given by 
= 0.0ls +1 
S$ 1062 +541 


H(s) = 


&(s) 
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In order to determine and plot the time response #(s) to the input u(t), we note that we 
have to determine the output of a system with transfer function H (s) to the input u(t). This 
can be done most easily by using state-space techniques. We will employ the MATLAB 
function tf2ss.m, which returns the state-space model of a system described by its transfer 


function. After determining the state-space representation of the system, the step response 
is obtained numerically. 


The function tf2ss.m takes the numerator and the denominator of the transfer function 
H (s) and returns A, B, C. and D, its state-space representation, in the form 


d 


X(t) = Ax(t) + Bu(t) 
dt 


y(t) = Cx(t) + Dult) 
This representation can be approximated by 
x(t + At) = x(t) + Ax(t)Ar + Bu(t)at 
y(t) = Cx(t) + Dutt) 
or, equivalently, 
xli +1) = xti) + Ax(i)At + BuliyAr 
yi) = Cx(i) + Duti) 


For this problem it is sufficient to choose u(r) to be a step function and the numerator 
and the denominator vectors of H{s) tobe (0.01 IJand[{ 1.01 1, respectively. With 
this choice of numerator and denominator vectors, the state-space parameters of the system 


will be 
-1.01 -1 
a=| a 


B 
c=(0.01 1) 
D=0 


The plot of the output of the PLL is given in Figure 7.35. 

As we can see from Figure 7.35, the output of the PLL eventually follows the input; 
however the speed by which it follows the input depends on the loop filter parameters and 
K, the VCO proportionality constant. 

The MATLAB script for this problem is given below. 





% MATLAB script for Hustrative Problem 9, Chapter 7 


echo on 
num={0.01 1}; 
den={1 1.01 1); 


[a.d,c,d}=tf2ss(nam.den); 
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Figure 7.35: The response of the PLL to an abrupt change in the input phase in Illustrative 
Problem 7.9. 


dt=0.01; 

usones(1,2000); 

x=zeros(2,2001); 

for i=1:2000 
x(t =x, +de rnar C, ijedt bauli); 
yi=c»a(; i), 

end 

t={0:dt:20]; 

plot(t(:2000),y) 





7.6.2 Clock Synchronization 


{n Chapter 5 and in this chapter we have seen that a popular implementation of the optimal 
receiver makes use of matched filters and samplers at the matched filter output. In all 
these cases we assumed that the receiver has complete knowledge of the sampling instant 
and can sample perfectly at this time. Systems that achieve this type of synchronization 
between the transmitter and the receiver are called timing recovery, clock-synchronization, 
or symbol-synchronization systems. 

A simple implementation of clock synchronization employs an early-late gate. The 
operation of an early-late gate is based on the fact that in a PAM communication system the 
output of the matched filter is the autocorrelation function of the basic pulse signal used in 
the PAM system (possibly with some shift). The autocorrelation function is maximized at 
the optimum sampling time and is symmetric. This means that, in the absence of noise, at 
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sampling times T* = T +5 and TT = T — ô, the output of the sampler will be equal; i.e., 
y(T*) = (77) (7.6.17) 


In this case, the optimum sampling ume is obviously the midpoint between the early and 
late sampling times: 


_ T+T 
z 2 


F (7.6.18) 


Now let us assume that we are not sampling at the optimal sampling time T, but instead 
we are sampling at 7}. If we take two extra samples at T+ = 7, +6 and TT = T; — 8, these 
samples are not symmetric with respect to the optimum sampling time T and, therefore, 


will not be equal. A typical autocorrelation function for positive and negative incoming 
pulses and the three samples is shown in Figure 7.36. 


matched filter output 4 


optimum sample 





fate sample 











Figure 7.36: The matched filter output and early and late samples. 
Here 
T =T-5, 
Tt =T+8 
where 
ô, <8 (7.6.19) 
and, as the figure shows, this results in 
PED > [7] (7.6.20) 
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Also, in this case 


T <T = = (7.6.21) 


Therefore, when lyr) > |y(T'*)], the correct sampling time is before the assumed 
sampling time, and the sampling should be done earlier. Conversely, when |y(7~)| < 
|y(7*)], the sampling time should be delayed. Obviously, when [T] = [T+], the 
sampling time is correct and no correction is necessary. 

The early-late gate synchronization system therefore takes three samples at 7), 77 = 
Tı —ô, and T+ = 7, + ô and then compares | y(7~)| and |»(7*)| and, depending on their 
relative values, generates a signal to correct the sampling time. 

ILLUSTRATIVE PROBLEM 


Illustrative Problem 7.10 [Clock synchronization] A binary PAM communication sys- 
tems uses a raised-cosine waveform with a rolloff factor of 0.4. The system transmission 
rate is 4800 bits/s. Write a MATLAB file that simulates the operation of an early-late gate 
for this system. 


Eiri 


Since the rate is 4800 bits/s, we have 





pee (7.6.22) 


and with æ = 0.4, the expression for a raised-cosine waveform becomes 


cos(4800 x 0.471) 
— 4 x 0.16 x 480021? 
cos [9202 
1.4746 x 107? 


This signal obviously extends from —oo to +00. The plot of this signal is given in Fig- 
ure 7.37. 

From Figure 7.37 it is clear that, for all practical purposes, it is sufficient to consider only 
the interval {t| < 0.6 x 1073, which is roughly [—3T, 37]. Truncating the raised cosine 
pulse to this interval and computing the autocorrelation function results in the waveform 
shown in Figure 7.38. 

In the MATLAB script given below, the raised-cosine signal and the autocorrelation 
function are first computed and plotted. In this particular example the length of the auto- 
correlation function is 1201 and the maximum (i.e., the optimum sampling time) occurs at 
the 600th component. Two cases are examined, one when the incorrect sampling time is 
700 and one when it is 500. In both cases the early-late gate corrects the sampling time to 
the optimum 600. 


x(t) = sinc(48001} 





= sinc(4800r) (7.6.23) 
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Figure 7.37: The raised-cosine signal in IHustrative Problem 7.10. 








Figure 7.38: The autocorrelation function of the raised-cosine signal. 
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a 


% MATLAB script for Illustrative Problem 10, Chapter 7. 
echo on 

alpha=0.4; 

T=1/4800; 

t=[—3eT:1,001*T/100:3*T]; 

xesinc(t./T).4(cos(pixalphast, /T)./(1—44alpha” 24t.*2/T*2)), 
pause % Press any key to see a plot of xt) 

plotit.x) 

yaxcorr(x); 

ty=[t—3aT t(2:leagth(t))+3+T), 

pause % Press any key to see u plor of the autocorrelation of x(t) 











plotity.y>; 

d=60; % Early and lute advance und delay 
ee=0.01; % Precision 

e % Step size 

n=700; % The incorrect sampling time 


while abs(abs(y(n+d))—abs(y(n—d))) >see 
if absiy(n+d))—abs(y(n—d))>O 
n=n+e; 
elseif abs(y(n+td))—abs(y(n—d)) <0 
nane; 
end 
end 
pause % Press any key to see the corrected sampling time 
n 
n=500; % Another incorrect sampling time 
while abs(abs(y(n+d))—abs(y(n—d)))>=ee 
if abs(y(n+d))—abs(y(n—d))>O 
nente: 
elseif abs(y(n+d))—absty(n—d))<0 
nan—e; 
end 
end 
pause % Press uny key to see the corrected sampling time 
n 
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Problems 


7.1 {n a carrier-amplitude-modulated PAM system, the transmitter filter has a square-root 
raised-cosine spectral characteristic with roll-off factor œ = 1. The carier frequency is 
fe = 40/T. Evaluate and graph the spectrum of the baseband signal and the amplitude- 
modulated PAM signal. 


7.2 Repeat Problem 7.1 when the carrier frequency is fe = 80/T. 


7.3 Repeat Problem 7.1 when the transmitter has a square-root duobinary spectral charac- 
teristic. 


7.4 The purpose of this problem is to demonstrate that (7.2.9) and (7.2.10) hold by evaluating 
(7.2.9) numerically using MATLAB. The pulse gy (1) may be assumed to be rectangular, 
ien, 


I, 0<? 


0, otherwise 


ro=| 


Let the carrier frequency fy = 2000 Hz. Use a sampling rate of F; = 20,000 samples/s on 
the signal waveform w (£) given by (7.2.6) and compute the energy of y(t) by approximating 
the integral in (7.2.8) by the summation 


1 N-1 1 Nel s 
2 
wy von aa EM (E) 


n=O n=0 


where N=40,000 samples. Write a MATLAB program to generate the samples ¥(n/F;) 
and perform the computation of the signal energy as described above. 


7.5 The cross correlation of the received signal r(#) with y(t) as given by (7.2.14) may 
be performed numerically using MATLAB. Write a MATLAB program that computes the 
correlator output 


vin = or(#)¥(Z). n=0,1....,N—1 


k=0 


where F, is the sampling frequency, Evaluate and graph y(n) when r(t) = w(t), where 
w(t) is the waveform described in Problem 7.4 and F;=20,000 Hz. 
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7.6 Evaluate and graph the correlation {¥(v)} in Problem 7.5 when the signal gr (ż) is 


oe $(1 = cos 71), O<1<2 
SENS 0, otherwise 
for the same parameters given in Problem 7.4. 
7.7 In Illustrative Problem 7.2, the eight PSK waveforms had a constant amplitude. Instead 
of the rectangular pulse g7 (t), suppose that the signal pulse shape is 


$d —cos2nt/T), O<:<T 
0, otherwise 


grlt) = | 


Write a MATLAB program to compute and graph the M = 8-PSK signal waveforms for 
the case in which fe = 6/T. 


7.8 Write a MATLAB program that numerically computes the cross correlation of the 
received signal r(r)} for a PSK signal with the two basis functions given by (7.3.9). That is, 
compute 


L fk k 
»wosDr($)e($) n=0,1,...,.N-1 


where N is the number of samples of r(t), y(t), and w2(r). Evaiuate and plot these 
correlation sequences when 


P(t) = Sme Wi (E) + Sms a(t) 
2, 0<st32 
sr(n= f otherwise 
fe = 1000 Hz, F,=10,000 samples/s, and the transmitted signal point is as given. 
a. Sm = (Sme, Sms) = (1,0) 
b. Sm = (—1, 0) 
C. Sm = (0, 1) 


7.9 Write a MATLAB program that performs a Monte Carlo simulation of an M = 4-PSK 
communication system, as described in Illustrative Problem 7.3, but modify the detector 
so that is computes the received signal phase 6, as given by (7.3.16) and selects the signal 
point whose phase is closes to 6,. 
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7.10 Write a MATLAB program that implements a differential encoder and a differential 
decoder fora M = 4 DPSK system. Check the operation of the encoder and decoder by 
Passing a sequence of 2-bit symbols through the cascade of the encoder and decoder and 
verify that the output sequence is identical to the input sequence. 


7.11 Write a MATLAB program that performs a Monte Carlo simulation of a binary DPSK 
communication system. In this case, the transmitted signal phases are # = 0 and @ = 180°. 
A @ = 0 phase change corresponds to the transmission of a zero. A @ = 180° phase 
change corresponds to the transmission of a one. Perform the simulation for N=10,000 
bits at different values of the SNR parameter £},/No. It is convenient to normalize £, to 
unity. Then, with o? = No/2, the SNR is £,/No = 1/202, where o? is the variance of 
the additive noise component, Hence, the SNR can be controlled by scaling the variance 
of the additive noise component. Plot and compare the measured error rate of the binary 
DPSK with the theoretical error probability given by (7.3.23). 


7.12 Write a MATLAB program that generates and graphs the M = 8-QAM signal wave- 
forms given by (7.4.2) for the signat constellation shown in Figure P7.12. 


B.D 








Figure P7.12 


Assume that the pulse waveform gr (t) is rectangular, i.e., 


va I, AETA 
Inia 0, otherwise 


and the carrier frequency is f. = 8/T. 
7.13 Repeat Problem 7.12 when the pulse waveform 8r(t) is given as 
1 
1 — cos 2xt/T), O<t<T 
nos [its 


z otherwise 
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7.14 Write a MATLAB program that performs a Monte Carlo simulation of an M = 8- 
QAM communication system for the signal constellation shown in Figure P?.12. Perform 
the simulation for N =10,000 (3-bit) symbols at different values of the SNR parameter 
Enay/No. It is convenient to normalize Epay to unity. Then, with o? = No/2, the SNR is 
Ebay /No = 1/207, where o? is the variance of each of the two additive noise components. 
Plot and compare the measured symbol-error rate of the QAM system with the upper bound 
on the theoretical error probability given by ( 7.4.12). 


nal constellation shown in 
QAM signal constellation 


7.15 Repeat the simulation in Problem 7.14 for the M = 8 
Figure P7.15. Compare the error probabilities for the two M 
and indicate which constellation gives the better performance 






U + V3.0) 








Figure P7.15 
7.16 Consider the binary FSK signals of the form 


2E 

w(t)= |<" cos2rfit,  O<t<T 
Th 
2E; 

w(t) = F cos2a fat,  OSt<Th 
b 


l 
n = fi + = 
hah ih 


Let fı = 1000/ Tp. By sampling the two waveforms at the rate F; = 5000/7}, we obtain 
5000 samples in the bit interval 0 < ¢ < Tp. Write a MATLAB program that generates the 
5000 samples for each of u ı (£) and u2(t) and compute the cross correlation 


PAORO 


and, thus, verify numerically the orthogonality condition for u(t) and u(t). 
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7.17 Use the MATLAB program given in Illustrative Problem 7.7 to compute and graph 
the correlator outputs when the received signal is 


rt) =oos(27fir+ 5), Osis Th 


7.18 Use the MATLAB program given in Hlustrative Problem 7.7 to compute and graph 
the correlator outputs when the transmitted signal is u2{£) and the received signal is 


r() = cos (22 far +), O<r<T 


7.19 Write a MATLAB program that performs a Monte Carlo simulation of a quaternary 
(M = 4) FSK communication system and employs the frequencies 





k 
t= fi =. =0,1,2,3 
keafts 
The detector is a square-law detector. Perform the simulation for N=10,000 (2-bit) symbols 
at different values of the SNR parameter £;/ Np. and record the number of symbol errors and 
bit errors. Plot and compare the measured symbol- and bit-error rates with the theoretical 
symbol- and bit-error probability given by (7.5.19) and (7.5.21). 


7.20 In Hlustrative Problem 7.9 it was assumed that the input phase has an abrupt jump, and 
the simulation showed that a first-order loop filter can track such a change. Now assume 
that the input changes according to 4 ramp, i.e., starts to increase linearly. Simulate the 
performance of a first-order PLL in this case and determine whether the loop is capable of 
tracking such a change. 


7.21 Repeat Illustrative Problem 7.10 with a rectangular pulse shape in the presence of 
AWGN for SNR values of 20, 10, 5, and 0 dB. 











Chapter 8 


Channel Capacity and Coding 


8.1 Preview 


The objective of any communication system is to transmit information generated by an 
information source from one location to another. The medium over which information is 
transmitted ts called the communication channel. We have already seen in Chapter 4 that 
the information content of a source is measured by the entropy of the source, and the most 
common unit for this quantity is bits. We have also seen that an appropriate mathematical 
model for an information source is a random Process. 

In this chapter, we consider appropriate mathematical models for communication chan- 
nets, We also discuss a quantity called the channel capacity that is defined for any com- 
munication channel and gives a fundamental limit on the amount of information that can 
be transmitted through the channel. In particular, we consider two types of channels, the 
binary symmetric channel (BSC) and the additive white Gaussian noise channel (AWGN), 

The second part of this chapter is devoted to coding techniques for reliable commu- 
nication over communication channeis. We discuss the two most commonly used coding 
methods, namely, block and convolutional coding. Encoding and decoding techniques for 
these codes and their performance are discussed in detail in the later sections of this chapter. 


8.2 Channel Model and Channel Capacity 


A communication channel transmits the information-bearing signal to the destination. In 
this transmission, the information-carrying signal is subject to a variety of changes. Some of 
these changes are deterministic in nature, e.g., attenuation, linear and nonlinear distortion; 
and some are probabilistic, e.g., addition of noise, multipath fading, etc. Since deterministic 
changes can be considered as special cases of random changes, in the most general sense 
the mathematical model for a communication channel is a stochastic dependence between 
the input and the output signals. In the simplest case this can be modeled as a conditional 
probability relating each output of the channel to its corresponding input. Such a model is 
called a discrete memoryless channel (DMC) and is completely described by the channel 
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input alphabet X, the channel output alphabet Y, and the channel transition probability 
matrix p(y | x). given forall x € X, y € Y. One special case of the discrete memoryless 
channel is the binary symmetric channel (BSC) that can be considered as a mathematical 
mode! for binary transmission over a Gaussian channe! with hard decisions at the output. 
A binary symmetric channe! corresponds to the case X = Y ={0, 1} and p(y = 0 | x = 
1) = p(y = l | x = 0) = e. A schematic model for this channel is shown in Figure 8.1 
The parameter € is called the crossover probability of the channel. 


le 


0 0 
Tks ee 








Figure 8.1: A binary symmetric channel (BSC). 


8.2.1 Channel Capacity 


By definition, channel capacity is the maximum rate at which reliable transmission of 
information over the channel is possible. Reliable transmission is possible when there 
exists a sequence of codes with increasing block length, for which the error probability 
tends to O as the olock length increases. The channel capacity is denoted by C; by the above 
definition, at rates R < C reliable transmisston over the channel is possible, and at rates 
R > C reliable transmission is not possible. 

Shannon’s fundamental result of information theory states that for discrete memoryless 
channels, the capacity is given by the following expression 


C = max I (X; Y) (8.2.1) 
píz) 


where (X; Y) denotes the mutual information between X (channel input) and Y (channel 
output) and the maximization is carried out over all input probability distributions of the 
channel. 

The mutual information between two random variables X and Y is defined as 


10K: 1) = E E popol og LE 


(8.2.2) 
ae PHP) 


where the mutual information is in bits and the logarithm is in base 2. 
For the case of the binary symmetric channel, the capacity is given by the simple relation 


C=1-Hp(e) (8.2.3) 


8.2. Channel Model and Channel Capacity 345 


where € is the crossover probability of the channel and H,{-) denotes the binary entropy 
function: 


Haix) = -x log(x) — (1 — x) log(1 — x) (8.2.4) 


Another important channel model is the bandlimited additive white Gaussian noise 
channel with an input power constraint. This channel is modeled as shown in Figure 8.2. 


z(t) 


y(t) 





Figure 8.2: Bandlimited additive white Gaussian noise channel. 
The channel is bandlimited to [—W, W], the noise is Gaussian and white with a (two- 
sided) power spectral density of No/2, and the channel input is a process that satisfies an 


input power constraint of P. Shannon showed that the capacity of this channel in bits per 
second is given by 


P 
c=Wh = its/sec 2. 
og (: + xan) bits/second (8.2.5) 


For a discrete-time additive white Gaussian noise channel with input power constraint 
P and noise variance ?, the capacity in bits per transmission is given by 


(8.2.6) 





ILLUSTRATIVE PR 


Illustrative Problem 8.1 [Binary symmetric channel capacity] Binary data are transmit- 
ted over an additive white Gaussian noise channel using BPSK signaling and hard-decision 
decoding at the output using optimal matched filter detection. 


1, Plot the error probability of the channel as a function of 


£ 
=— 2T 
=M (8.2.7) 
where £ is the energy in each BPSK signal and No/2 is the noise power spectral 
density. Assume that y changes from —20 dB to 20 dB. 


2. Plot the capacity of the resulting channel as a function of y. 
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E 


1. The error probability of the BPSK with optimal detection is given by 


p= 0(V%) (8.2.8) 


The corresponding plot is shown in Figure 8.3. 
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Figure 8.3: BPSK error probability versus y = Ā 


2. Here we use the relation 
C =1~ H(p) 
=1-m (0 (V2) (8.2.9) 
to obtain a plot of C versus y. This plot is shown in Figure 8.4. 


The MATLAB script for this problem is given below. 








% MATLAB script for IHustrutive Problem I, Chapter R. 
echo on 

gamma.db=[-—20:0.1:20); 

gamina=10.*(gamma_db./10); 
p-error=q(sqrt(2.*xgamma)), 
capacity=1.—entropy2(p_error); 

pause % Press a key to see a plot of error probability vs. SNR/bit 
cif 

semilogx(gamma,p-error) 

Xlabel(' SNR/bit’) 

ide(‘Error probability versus SNR/bit’) 
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Figure 8.4: Channel capacity versus y = A 


ylabel{‘Exror Prob.) 


pause % Press a key to see a plot of channel capacity vs, SNR/bit 
cif 


semilogx(gamma,capacity) 

xlabel(’ SNR/bit’) 

tile("Channel capacity versus SNR/bit’) 
ylabel(- Channel capacity’) 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.2 [Gaussian channel capacity] 








L. Plot the capacity of an additive white Gaussian noise channel with a bandwidth of 
W = 3000 Hz asa function of P/No for values of P /Nọ between —20 and 304B. 


2. F: st the capacity of an additive white Gaussian noise channel with P/No = 25 dB 


as a function of W. In particular, what is the channel capacity when W increases 
indefinitely? 


ED 


L The desired plot is given in Figure 8.5, 





2. The capacity as a function of bandwidth is plotted in Figure 8.6. 


As is seen in the plots, when either P/Ny or W tend to zero, the capacity of the 
channel also tends to zero. However, when P/No or W tends to infinity, the capacity 
behaves differently. When P/No tends to infinity, the capacity also tends to infinity, 
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as shown in Figure 8.5. However, when W tends to infinity, the capacity does go to 
a certain limit, which is determined by P/Np. To determine this limiting value we 


200 











10° 
P/No 


Figure 8.5: Capacity of an AWGN channel with W = 3000 Hz as a function of P{No. 
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Figure 8.6: Capacity as a function of bandwidth in an AWGN channel. 














have 
P 
~ Noln2 
= 1.4427— 
0 
The MATLAB script for this problem is given below. 
% MATLAB script for Hlustrative Problem 2, Chupier 8. 
echo on 
pn0_db=[~20:0.1:30}; 
pn0=10. *(pn0_db./10); 
capacity=3000.+log2(1+pn0/3000), 
pause % Press a key to see a plot of channel capacity vs. P/NO 
olf 
semilogx(pnO,capacity) 
litle(‘Capacity vs. P/NO in an AWGN channel’) 
xlabel{ ' P/NO’) 
ylabel(‘ Capacity (bits/second) ‘) 
clear 
w=[1:10,12:2:400,105:5:500,510:10:5000,5025:25:20000,20050:50: 100000): 
pn0-db=25; 


pn0=10^(pn0-db/10); 

capacity=w.slog2(1+pn0./w); 

pause % Press a key to see a plot of channel capacity vs. bundwidih 
clf 

semilogx(w.capacity) 

title(* Capacity vs. bandwidth in an AWGN channel’) 
xlabel(‘Bandwidch (Hz) "} 

ylabei(*Capacity (bits/second) ‘) 








ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.3 [Capacity of binary input AWGN channel] A binary input 
additive white Gaussian noise channel is modeled by the two binary input levels A and 
—A and additive zero-mean Gaussian noise with variance 07. In this case X = {—A, A}, 
Y = R, p(y | X = A) ~ N(A,a?), and p(y | X = -A) ~ W(-A,o”). Plot the 


capacity of this channel as a function of A/c. 


—CE — 





Due to the symmetry in the problem the capacity is achieved for uniform input distri- 
bution, i.e., for p(X = A) = p(X = —A) = } For this input distribution, the output 


distribution is given by 


1 z 2/292 1 =(y-A)2/202 
p(y) = ———e (y+A)l]20° 4 e70 Po 
22702 Wro? 
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and the mutual information between the input and the output is given by 


1 fe p(y |X =A) 
HX; ¥) = = | X = A) log “= dy 
(X; Y) 3 feo Nog, T y 
1 fe y|X =A 
+f ply |X =—A) log, PLX EA gy (8.2.13) 
2 Ice j pty) 


Simple integration and change of variables results in 
l A I A 
rant e(A\aly (A 8.2.14 
(X; Y) 3f (4) + sf( >) ( ) 
where 


enna) 


(8.2.15) 





Using these relations we can calculate 7(X; Y) for various values of á and plot the result. 
A plot of the resulting curve is shown in Figure 8.7. 
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Figure 8.7: Capacity of a binary input AWGN channel as a function of SNR=A/o. 


The MATLAB script for this problem follows. 





% MATLAB script for Mlustrative Problem 3, Chapter 8. 
echo on 

a..db=[—20:0.2:20]; 

a=10."(a.db/10); 

for i=1:201 
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f@=quad(’ i13_8£un° a(i)—5.a(i45,1e-3,{ Jali); 
g¢i)=quad( ’ i23_8£un’—a(i)—5,—a(i}+5,1e—3,{ ].-a(i)): 
c(i)=0.54f(i)+0.54g(i); 

end 


pause % Press a key to see capacity vs. SNR plot, 
semilogx(a,c) 


tule(’ Capacity versus SNR in binary input AWGN channel’) 
xlabel(" SNR’) 
ylabel(’ Capacity (bits/transmission}’) 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.4 [Comparison of hard- and soft-decision schemes] A binary 
input channel uses the two input levels A and —A. The output of the channel is the sum of 
the input and an additive white Gaussian noise with mean 0 and variance 0. This channel 
is used under two different conditions. In one case, the output is used directly without 
quantization (soft decision), and in the other case, an optimal decision is made on each 
input level (hard decision). Plot the capacity in each case as a function of A/a. 


em SOLUTION J 


The soft-decision part is similar to Wustrative Problem 8.3. For the hard-decision 
case the crossover probability of the resulting binary symmetric channel is Q(A/o), and 
therefore the capacity is given by 


cons (a(8) 


Both Cy and Cs, are shown in Figure 8.8. Soft-decision decoding outperforms hard- 
decision decoding at alj values of A/c, as expected. 
The MATLAB script for this problem is given below. 

















% MATLAB script for llustrative Problem 4, Chapter 8. 
echo on 

a.db=[—13:0.5:13]; 

a=10."(a_db/10); 











=quad(* i13_8 fun ali)—5.a(i)+5,1e—3.{ Jali); 

gü=quad( i13_8 fun —ali)~5,-a(i)+5,1e—3,[ ],-a(i); 
c_soft(i)=0.5xf(i)+0.54g(i); 

end 

Pause % Press a key to see the cupacity curves 

semilogx(a.c-soft,a.c_hard) 
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Figure 8.8: Plots of Cy and Cs versus SNR = A/o. 





ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.5 [Capacity versus bandwidth and SNR] The capacity of a band- 
limited AWGN channel with input power constraint P and bandwidth W is given by 


P 
C = W log: ( + az) 


Plot the capacity as a function of both W and P/No. 


Eni» — 


The desired plot is shown in Figure 8.9. Note that for constant P/No, the plot reduces 
to the curve shown in Figure 8.6. For constant bandwidth, the capacity as a function of 
P /No is similar to the curve shown in Figure 8.5. 

The MATLAB script file for this problem is given below. 


E 


% MATLAB script for Illustrative Problem 5, Chapter 8. 
echo off 
1:5:20,25:20: 100,130:50:300,400:100: 1000, 1250:250:5000,5500:500: 10000): 
=(-20:1:30}; 
pn0=10.>(pn0_db/10); 
for i= 1:45 
for j 
e(i,j) 
end 
end 
echo on 























=w(i)elog2t1+pa0(j)/w(id): 
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Figure 8.9: Capacity as a function of bandwidth and SNR in an AWGN channel. 
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pause % Press a key to see C vs. W and P/NO. 
k=(0.9,0.8,0.5,0.6]; 

s=(~70,35]; 

surfi(w,pn0_db.c’ , s, k) 

title(‘Capacity vs. bandwidth and SNR‘) 


ILLUSTRATIVE PROBLEM 


Mlustrative Problem 8.6 {Capacity of discrete-time AWGN channel] Plot the capacity 
of the discrete-time additive white Gaussian noise channel as a function of the input power 
and the noise variance. 


em 


The desired plot is given in Figure 8.10. 
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Figure 8.10: Capacity of the discrete-time AWGN channel as a function of the signal power 
(P) and the noise power (a*), 


The MATLAB script file for this problem is given below. 





% MATLAB script for Mlustrative Problem 6, Chapter 8. 
echo on 
p-db=[-20:1:20]; 
db; 
.^(p-db/10); 
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np=p: 
for i=1:41 
for j=1:41 
cli j)=0.5slogX1 +pii)/npij)): 
end 
end 


pause % Press a key to see the plot 
surfi(np_db,p-db.c) 





8.3 Channel Coding 


Communication through noisy channels is subject to errors, In order to decrease the effect 
of errors and achieve reliable communication, it is necessary to transmit sequences that 
are as different as possible so that the channel noise will not change one sequence into 
another. This means some redundancy has to be introduced to increase the reliability of 
communication. The introduction of redundancy results in transmission of extra bits and a 
reduction of the transmission rate. 

Channel coding schemes can be generally divided into two classes, block codes and 
convolutional codes. In block coding, binary source output sequences of length & are 
mapped into binary channel input sequences of length n; therefore, the rate of the Tesulting 
code is k/n bits per transmission. Such a code is called an {n, k) block code and consists of 
2* codewords of length n, usually denoted by c),¢2,... , cx. Mapping of the information 
source outputs into channel inputs are done independently, and the output of the encoder 
depends only on the current input sequence of length & and not on the previous input 
sequences. In convolutional encoding, source outputs of length ko are mapped into no 
channel inputs, but the channel inputs depend not only on the most recent kọ source outputs 
but also on the last (Z — !)ky inputs of the encoder. 

One of the simplest block codes is the simple repetition code, in which there are two 
messages to be transmitted over a binary symmetric channel, but instead of transmitting a 0 
and a | for the two messages, two sequences, one consisting of all 0's and one consisting of 


all 1’s are transmitted. The length of the two sequences is chosen to be some odd number 
n. The encoding process is shown below: 


nodd 
—~ 
0 — 00...00 (8.3.1) 
nodd 
aaa 
1—11... 1 (8.3.2) 


The decoding is a simple majority vote decoding; that is, if the majority of the received 
symbols are I's, the decoder decides in favor of a 1, and if the majority are 0's, the decoder 
decides in favor of a 0. 

An error occurs if at least (n + 1)/2 of the transmitted symbols are received in error. 
Since the channel is a binary symmetric channel with crossover probability €, the error 
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probability can be expressed as 


a= È (ta-o (83.3) 


kane l)/2 


For example, with n = 5 and € = 0.001 we have 


5 
Pe= $ 0.0014 0,999) = 9.99 x 107! æ 107° (8.3.4) 
k=3 


This means that by employing the channel five times, instead of just once, we can reduce 
the error probability from 0.001 to 107°. Of course, a price has been paid for this more 
reliable performance; that price is a reduction in the rate of transmission and an increase 
in the complexity of the system. The rate of transmission has been decreased from one 
binary message per one use of the channel to one binary message per five usages of the 
channel. The complexity of the system has been increased because now we have to use 
an encoder (which has a very simple structure) and a decoder, which implements majority 
vote decoding, More reliable transmission in this problem is achieved if we increase n. For 
instance, for n = 9 we have 


9 
Pe = J 0.0014 (0.999)?=* = 9.97 x 107! = 1071 (8.3.5) 
kmS 


From above it seems that if we want to reduce the error probability to zero, we have to 
increase n indefinitely and, therefore, reduce the transmission rate to zero. This, however, 
is not the case, and Shannon showed that one can achieve asymptotically reliable communi- 
cation (i.e., pe — 0} by keeping the rate of transmission below the channe! capacity, which 
in the above case is 


C = i — A,(0.001) = | — 0.0114 = 0.9886 _ bits/transmission (8.3.6) 


This, however, is achieved by employing encoding and decoding schemes that are much 
more complex than the simple repetition code. 
ILLUSTRATIVE P LEM 





llustrative Problem 8.7 [Error probability in simple repetition codes} Assuming that 
e = 0.3 ina binary symmetric channel, plot pe as a function of the block-length n. 


Ei» 


We derive pe for values of n from 1 to 61. The error probability is given by 


i 
pe DY (s x 0.7" 
kæín+1)/2 





and the resulting plot is shown in Figure 8.11. 
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The MATLAB script file for this problem is given below. 


E ME E 








% MATLAB script for Hlustrative Problem 7, Chapter 8. 
echo on 





pUi)=pli)+ prod(1:i)/(prod( 1 j)*prod(t(i—j))}*ep “jx —ep)* (i=j); 

end 
end 
pause % Press a key w see the plot 
stem((1:2:61),p(1:2:61)) 
xlabel(‘n") 
ylabel(‘ pe‘) 
title(’ Error probability as a function of n in simple repetition code’) 
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Figure 8.11: Error probability of a simple repetition code for € = 0.3 and n = 1, 2, ..., 61. 


8.3.1 Linear Block Codes 


Linear block codes are the most important and widely used class of block codes. A block 
code is linear if any linear combination of two codewords is a codeword. In the binary case, 
this means that the sum of any two codewords is a codeword. In linear block codes the 
codewords form a k-dimensional subspace of an n-dimensional space. Linear block codes 
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are described in terms of their generator matrix G, whichis ak xn binary matrix such that 
each codeword ¢ can be written in the form 


e=uG (8.3.7) 


where u is the binary data sequence of length k (the encoder input). Obviously, the all-O 
sequence of length n is always a codeword of an (n, k) linear block code. 


An important parameter in a linear block code, which determines its error-correcting 
capabilities, is the minimum (Hamming) distance of the code, which is defined as the 
minimum Hamming distance between any two distinct codewords. The minimum distance 
of a code is denoted by dinin, and we have 


dimn = min dy (ci, cj) (8.3.8) 
tA 


For linear codes the minimum distance is equal to the minimum weight of the code, defined 
by 


Wmin = Min w(e;) (8.3.9) 
#0 


i.e., the minimum number of 1’s in any nonzero codeword, 
ILLUS ATIVE P BLEM 





Illustrative Problem 8.8 [Linear block codes] The generator matrix for a (10, 4) linear 
block code is given by 


HoH o 


0 
l 
I 
0 


E 
-- om 
E 


oll 
i E GE i 
010 
10 0 


i, O 
-00m 


Determine all the codewords and the minimum weight of the code. 


ED 


In order to obtain all codewords, we have to use all information sequences of length 4 
and find the corresponding encoded sequences. Since there is a total of 16 binary sequences 
of length 4, there will be 16 codewords. Let U denote a 2% x k matrix whose rows are all 
possible binary sequences of length k, starting from the all-0 sequence and ending with the 
all-1 sequence. The rows are chosen in such a way that the decimal Tepresentation of each 
row is smaller than the decimal representation of all rows below it. For the case of k = 4, 
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the matrix U is given by 








0000 
0001 
0010 
0011 
0100 
O64 
0110 
CF My 
V=] 0o00 
1001 
1010 
Poul 
1100 
ea ae 
1110 
vor ay 1] 
We have 
C=UG (8.3.10) 


where C is the matrix of codewords, which in this case is a 16 x 10 matrix whose rows are 
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the codewords. The matrix of codewords is given by 











fo 0 0 0] 

0001 

0010 

ooll 

0100 

0101 

Ooi tolfioorltoi1i1t 
culo PL ijfi t tooo tt do 
“Jt 0 0 oO} ]0 1 tOtT10O101 
10 o01;/{1 totltitoot 
1010 

1011 

1100 

1101 

el ed E +! 

(raaa 
[0000000 06 0] 
1101111001 
o110110101 
1olr1t:oottoo 
iitoootil1dio 
ooirliiloilst 
1000111014 
_jo10to000010 
“Jrooft?rod2ldt 
0100001110 
1111000010 
oo10111011 
Orrititootl 
10to000000 
0001001100 
1100110101 


A close inspection of the codewords shows that the minimum distance of the code is dmin = 
2. 
The MATLAB script file for this problem is given below. 


mem VOILE 


% MATLAB script for Illustrative Problem 8, Chapter 8. 
% generate U, denoting all information sequences 
k=4; 
for i=1 
for j=k:-1:1 
if rem(i-1,2°(~-j+k+1))>=2*(—j+k) 











wk 
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a 
Š 
$ 
ž 
È 
K 


Ron 


% generate codewor 
c=rem(usg.2); 

% find the minimum distance. 
w-minemin(sum((c(2:27 k.:))! } ) ; 


s 


A linear block code is in the systematic form if its generator matrix is in the following 
form 


1 0 O Piy Pi? o Pin-k 
ge 0 t 0 Pal pra e Pinak (8.3.11) 
o 0 f L pkai peo a Pk.n-k 
or 
G=[k| P] (8.3.12) 


where F denotes the k x k identity matrix and P is ak x (» — k) matrix. In a systematic 
code, the first k binary symbols in a codeword are the information bits, and the remaining 
n — k binary symbols are the partty-check symbols. 

The parity-check matrix of a code is any (n — k) x n binary matrix H such that for all 
codewords ¢ we have 


cH =0 (8.3.13) 
Obviously, we will have 
GH =0 (8.3.14) 
and if G is in systematic form, then 
H=([P'| i] (8.3.15) 


Hamming Codes 


Hamming codes are (2” — 1,2 — m — 1) linear block codes with minimum distance 3 
and a very simple parity-check matrix. The parity-check matrix, which is an m x (2 ~ 1) 
matrix, has all binary sequences of length m, except the all-O sequence, as its columns. For 
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instance, for m = 3, we have a (7,4) code whose parity-check matrix in the systematic 
form is 


EC trI g 

A=]! 101010 (8.3.16) 
01121001 

From this we have 

1000110 
0100011 

G= 0010101 (8.3.17) 
0007111 1 





ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.9 (Hamming codes] Find all the codewords of the (15, 11) Ham- 
ming code and verify that its minimum distance is equal to 3. 


Ei 





Here 
1o001t1031 0 ttt1tt100 0 
4100 0f tf? 0110100 
Fi 3.18, 
Flo 1410011101001 0 ele) 
OO Oe ae PO. a DO Le a0" 
and, therefore, 
1900000000011 00 
0t: 0000000000i tO 
00100000090000 lI 
o0010000000:010 
900010000001001 
G=|0 000010000001 01 
000000 !100001110 
o000000 10000111 
9000000010010 8 ¢t 
9000000001 01t101 
900000000011 111 


There is a total of 2'! = 2048 codewords, each of length 15. The rate of the code is 
4 = 0.733. In order to verify the minimum distance of the code, we use a MATLAB script 
similar to the one used in the Illustrative Problem 8.8. The MATLAB script is given below, 
and it results in dmin = 3. - 
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EnD- 


% MATLAB script for illustrative Problem 9, Chapter 8. 
echo on 
k=11 
for i=1:27k 
for j=k:—1:1 
if rem(i-1,27(—j+k+1))>=27(~j+k) 
ufij)s1: 














else 
uiij)=0 
end 
end 
end 
e1100000000001100; 
010000000000110; 
001000000000014; 
000100000001010; 
000010000001001; 
0900001000000101; 
000000100001110: 
000000010000111; 
000000001001011; 
000000000101101; 
0000000000113111}; 
c=rem{u+g,2), 


w_min=min{sum((c(2:27 29) ) ; 





Performance of Linear Block Codes 


Linear block codes can be decoded using either soft-decision decoding or hard-decision 
decoding. In a hard-decision decoding scheme, first a bit-by-bit decision is made on the 
components of the codeword, and then, using a minimum Hamming distance criterion, the 
decoding is performed. The performance of this decoding scheme depends on the distance 
structure of the code, but a tight upper bound, particularly at high values of the SNR, can 
be obtained in terms of the minimum distance of the code. 

The (message) error probability of a linear block code with minimum distance min» in 
hard-decision decoding, is upper bounded by 


Pe S (M — 1) [4p(1 — p)}énn/? (8.3.19) 


where p denotes the error probability of the binary channel (error probability in demodu- 
tation) and M is the number of codewords (M = 24). 

In soft-decision decoding, the received signal is mapped into the codeword whose 
Corresponding signal is at minimum Euclidean distance from the received signal, The 
message-crror probability in this case is upper-bounded by 


dé 
Pe S(M -1)Q ( ) (8.3.20) 
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where M = 24 is the number of codewords. No is the one-sided noise power spectral 
density, and dÈ is the minimum Euclidean distance of the code and is given by 


Gu = for orthogonal signaling 83.21) 


V2dmin£ for antipoda! signaling 


which results in 


p 


(M —1)Q (s ) for orthogonal signaling 





2No 
pee 
dminE 


ove (y 


In these inequalities dmin is the minimum Hamming distance of the code and £ denotes the 
energy per each component of the codewords. Since each codeword has n components, the 
energy per codeword is nẸ , and since each codeword carries k information bits, the energy 
per bit, Ep is given by 


Pes (8.3.22) 





) for antipodal signaling 


Er= as (8.3.23) 


where Re = k/n denotes the rate of the code. Therefore, the above relations can be written 


as 
din RE; 
(M —1)Q ( ahs for orthogonal signaling 
. (8.3.24) 


aminReE} 
(M-DO ( Sonn ee 
No 


Pes 
) for antipodal signaling 


The bounds obtained above are usually useful only for large values of yp = £,/No. For 
smaller yp values, the bounds become very loose and can even exceed 1. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.10 {Performance of hard-decision decoding] Assuming that the 
(15,11) Hamming code is used with antipodal signaling and hard-decision decoding, plot 
the message-error probability as a function of yp = £,/No. 


nip 


Since antipodal signaling is employed, the error probability of the binary channel is 
given by 








p= ( E) (8.3.25) 
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where £ is the energy per component of the code (energy per dimension) and is derived 
from £» by 





E = ER, (8.3.26) 
Therefore, 
2R- En 
p=Q (| No ) (8.3.27) 


where Re = k/n = H = 0.73333. Since the minimum distance of Hamming codes is 3, 
we have 


pe < (2! = 1) (4901 = pye? 


fae 1s 
= 2047 (o ( s ) ( -0 ( : aoe ))) (8.3.28) 
0 0 


The resulting plot is shown in Figure 8.12. 








Ph 10° 











Figure 8.12: Error probability as a function of yp for a (15,11) Hamming with hard-decision 
decoding and antipodal signaling. 


; The MATLAB function for computing the bound on message-error probability of a 
linear block code when hard-decision decoding and antipodal signaling is employed is 
given below. 


EO 


function [p-err,gamma_db]=p-e_hd_a(gamma_db_,gamma_db_h,k,n,d_min) 
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% pehdt.m Matlab function for computing error probability in 


% hard-decision decoding of a linear block code 

% when antipodal signaling is used. 

% (p-errgammadb] = pe hd atgamma-db d. gamma db hk,nd min) 
% gammadbt = lower E.b/ND 

% gummaulb.ti = higher E_b/NO 

% k = number of information bits in the code 

% n = code block length 

% damin = minimum distance of the code 





igamma_db-1:(gammna.db_h—ganma-db.1)/20-gamma-db_h] 
10.” (gamma-db/10); 


R-c=k/n; 


(sqrt(2.*R_c.*gamma_b)); 
pwerts(2°k—-1).0(4«p.b.«(1—p.b)), *(d_min/2): 








In the MATLAB script given below, the above MATLAB function is employed to plot 
error probability versus yp. 








% MATLAB script for Hlustrative Problem 10. Chapter & 
{p-err_ha,gamma_bj=p-ehd_a(10,16,11,15.3). 
semilogy(gammia_b,p_ert_-ha} 


ILLUSTRATIVE PROBLEM 


INustrative Problem 8.11 (Hard-decision decoding] lf the (15, 1!) Hamming code is 
used with an orthogonal binary modulation scheme instead of the antipodal scheme, plot 
the message-error probability as a function of yp = £p/ No. 


ETD 


The problem is similar to Illustrative Problem 8.10, except that the crossover probability 
of the equivalent binary symmetric channel (after hard-decision decoding) is given by 


E 
=0 ( fz ) (8.3.29) 











Using the relation 


E = ErR. (8.3.30) 
we obtain 
R£p 
= — 3.31 
p=Q ( No ) (8.3.31) 
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and, finally, 


pe s (2 - 1) [pil = pimi? 


[0.733E, fo73e, \\\"" 
e(a FE) E e 


The p,-versus-£»/No plot is shown in Figure 8.13. 
The MATLAB file for this problem is given below. 











% MATLAB script for Illustrative Problem 11, Chupter 3. 
echo on 

gamma_b-db={—4:1:14): 
gamma_b=10.*(gamma_b_db/10); 
qq=a(sqrt(0.733.«gamma_b)); 

p-err=2047 +q. *2.«(3-2.4yq); 

pause % Press a key to see p err versus gamma b curve 
loglog(gaimma_b,p_err) 
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Figure 8.13: Error probability versus yp of a (15,11) code with orthogonal signaling and 
hard-decision decoding. 


As we observe from Figure 8.13, for lower values of ¥p the derived bound is too loose. 
In fact, for these values of yp the bound on the error probability is larger than 1. It is also 
instructive to plot the two error probability bounds for orthogonal and antipodal signaling 
on the same figure. This is done in Figure 8.14. The superior performance of the antipodal 


signaling compared to orthogonal signaling is readily seen from a comparison of these two 
plots. 
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Orthogonal signaling 


Antipodal signaling 











Figure 8.14: Comparison of antipodal and orthogonal signaling. 


The MATLAB function for computing the message-error probability in the case of 
hard-decision decoding with orthogonal signaling is given below. 








function (p-er,gamma_db]=p_e_hd_o(gamma_db-i,gamma_db_h,k,n,d_min) 
% petdo.m  Murlab function for computing error probability in 


% hurd-decision decoding of a linear block code 

% when orthogonal signaling is used. 

% [p-errgammua-db} = puehdo\gummadbtgammadb-hkndmin) 
% gamma.dbt = lower EbjND 

% gammadbA = higher Eb/ND 

% k = number of information bits in the code 

% n = code block length 

% dnin = minimum distance of the code 


gamma_db=[gamma_db l:(gamma_db-h—gamma_db_1)/20:gamma_db-h]; 
gamma_b=10.*(gamma_db/10); 

R.csk/n; 

(sqr(R_c.*gamena..b)); 

peerr=(27k—1).4(4ep_b.4(1—-p_b)).“ (d_min/2); 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.12 [Soft-decision decoding] Solve Illustrative Problem 8.11 when 
soft-decision decoding is used instead of hard-decision decoding, 
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em SOLUTION J 


In this case we have to use Equation (8.3.24) to find an upper bound for the error 





probability. In the problem under study, dmin = 3, R, = $}, and M = 2!) — 1 = 2047, 
Therefore, we have 
dmin RE; 
(M- DO (\ or N 2 ) for orthogonal signaling 
No 
Pe S 
Amin ReEp : raat 
(M —1)Q (| dett ) for antipodal signaling 
o 
|11 En 
20479 { | — Sh sig 
2 Q (y 10 Mo for orthogonal signaling 


2047Q ( SENG ) for antipodal signaling 
0 


The corresponding plots are shown in Figure 8.15. The superior performance of antipodal 
signaling is obvious from these plots. 


Pe x08 z 
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Figure 8.15: Message-error probability versus yp for soft-decision decoding. 


Two MATLAB functions, one for computing the error probability for antipodal signaling 
and one for computing the error probability for orthogonal signaling when soft-decision 
decoding is employed, are given below. 
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ara» 


function [p-err,gamma_db}=p_e_sd_a(gamma_db_,gamma_db_h,k,n,d_mia) 
% pesdam — Matlab function for computing error probability in 








soft-decision decoding of a linear block code 

when antipodal signaling is used. 

Ip-erngumma.tb] = p.e-sd-a(yamma_dbtgamma_db_hk,n.d_min) 
gamma! = lower E_b/NO 

gammaibh = higher Eb/NO 

k = number of information bits in the code 

n = code block length 

damin = minimum distance of the code 


ARRI KK LL 


gammadb=(gamma.db_I:(gamma_db_h—gamma_db_l)/20:gamma_db_h]; 
gamma_b=10."(gamma.db/ 10); 

R-c=k/n; 

p-em=(2°k—1).sqisqrid-min.eR_c *gomma-b)); 


-ema 


function [p-err.gamma_db]=p_e_sé_o(gamma_db_1,gamma_db_h,k,n,d_min) 











% pesdo.m  Mailub function for computing error probability in 

soft-decision decoding of a linear block code 

when orthogonul signaling is used. 

{p-2rrgummadb] = p_esd o{gammadb L. gamma db h,knd min) 
gummadbt = lower Eb/N0 

gamma dbh = higher Eb/NO 

k = number of information bits in the code 

n = code block length 

din = minimum distance of the code 


HRKFRKRRKSMAAS 


gamma_db=[gamma_db-1:(gamma_db-h~gamma.db_1)/20:gamma_db_h]: 
gamma.b=10.*(gamma_db/10); 

Rc=k/a: 

perr=(2°k~1).xq(sqet(d_min.+R_c.+gamma_b./2)); 





In Figure 8.16, four plots corresponding to antipodal and orthogonal signaling with soft- 
and hard-decision decoding are shown. 


The MATLAB script that generates this figure is given below. 


e 


% MATLAB script for Mustrative Problem 12, Chapter & 
(p-err_ha.gamma_b]=p-e_hd_a(10,16,11,15,3); 
{p-err-ho,gamma_b}=p..c_hd_o(10,16,11,15,3); 

{p-err_so,gamma.b| sd.0(10,16,11,15,3); 
(p-err_sa,gamma-b]=p_e.sd_a(10,16,11,15.3); 
semilogy(gamma_b,p.ert_sa,gamma_b,p_err_so,gamma_b,p_err_ha,gamma_b,p_ert_ho) 
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Figure 8.16: Comparison of antipodal/orthogonal signaling and soft/hard-decision decod- 
ing. 


8.3.2 Convolutional Codes 


In block codes each sequence of k information bits is mapped into a sequence of n channel 
inputs in a fixed way regardless of the previous information bits. In convolutional codes 
each sequence of ko information bits is mapped into a channel input sequence of length no 
but the channel input sequence depends not only on the most recent ko information bits but 
also on the last (Z — 1)kq inputs of the encoder. Therefore, the encoder has the structure of 
a finite-state machine, where at each time instance the output sequence depends not only 
on the input sequence, but also on the state of the encoder, which is determined by the tast 
(L ~ 1)ko inputs of the encoder. The parameter L is called the constraint length of the 
convolutional code.' A binary convolutional code is, therefore, a finite-state machine with 
2#0(L-)) states, The schematic diagram for a convolutional code with ko = 2, no = 3, and 
L = 4 is shown in Figure 8.17. 

In this convolutional encoder the information bits are loaded into the shift tegister 2 bits 
at a time, and the last 2 information bits in the shift register move out. The 3 encoded bits 
are then computed as shown in the figure and are transmitted over the channel. The rate of 
this code is, therefore, R = 2. Note that the 3 encoder outputs transmitted over the channel 
depend on the 2 information bits loaded into the shift register as well as the contents of the 
first three stages (6 bits) of the shift register. The contents of the last stage (2 bits) have no 
effect on the output since they leave the shift register as soon as the 2 information bits are 
loaded into it. 





! Some authors define m = Lkg as the constraint length, and some prefer (L — 1)ky as the constraint length. 
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Figure 8.17: A convolutional code with ky = 2, no = 3, and L = 4. 


A convolutional code is usually defined in terms of the generator sequences of the 
convolutional code, denoted by g). g2,... . Zn. The ith component of gj, 1 <i < kob 
and | < j < n, is | if the ith element of the shift register is connected to the combiner 
corresponding to the jth bit in the output and 0 otherwise. For example, in the convolutional 
code depicted in Figure 8.17, we have 


g=0 ^ t O 1 0 0 J 
g=0 0 0 0 0 0 0o N 
g=0 0 0 0 0 0 0 J 


AS soon as g1, £2... . gn are specified, the convolutional code is uniquely determined. 
We also define the generator matrix of the convolutional code as 


£i 
Gae 
t 
which is, in general, an n x kọL matrix. For the convolutional code shown in Figure 8.47 
we have 


0010100 1 
Gajo 0000001 
10000001 


It is helpful to assume the shift register that generates the convolutional code is loaded 
with O's before the first information bit enters it (i.e., the encoder is initially in zero state) and 
that the information bit sequence is padded with (L — L}ko 0’s to bring back the convolutional 
encoder to the all-O state. We also assume that the length of the information-bit sequence 
(input to the convolutional encoder) is a multiple of ko. If the length of the input sequence 
is not a multiple of ko, we pad it with O's such that the resulting length is a multiple of ko. 
This is done before adding the (L — 1)ko O's indicated earlier in this paragraph. If, after the 
first zero-padding, the length of the input sequence is niko, the length of the output sequence 
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will be {n + L — 1)ag, so the rate of the code will be 


nko 
(n+L—1)no 
In practice n is much larger than L; hence, the above expression is well approximated by 
= ko 


R= 
no 


The MATLAB function con-encd.m given below generates the output sequence of the 
convolutional encoder when G, ko, and the input sequence are given. Note that zero-padding 
of the input sequence is done by the MATLAB function. The input sequence (denoted by 
the parameter “input”) starts with the first information bit that enters the encoder. The 
parameters no and L are derived from the matrix G. 


a 


function output=cnv_encd(g,kO,input) 

env encdtg,kO,input) 

determines the output sequence of a binary convolutional encoder 
g is the generator matrix uf the convolutional code 

with nO rows and 1k0 columns, tts rows are g1.g2,....3n 

AO is the number of bits entering the encoder at each clock cycle. 
input = the binary input seq 





RRRRRA 


% check to see if extra zero-padding is necessary 
if rem(ength(input).k0) > O 
input=[input,zeros(size(1-k0—rem(length(input).k0)))]: 


n=length(input)/k0; 
% check the size of matrix g 
if rem(sizetg.2).k0) > 0 
emort’ Error, g is not of the right size.’) 
end 
% determine | and nO 
tesize(g,2)/k0; 
nO=size(g,1); 
% add extra zeros 
u=(zeros(size(1:(I—1)*k0)) input.zeros(size(1:(1—1)#k0))]; 
% generate uu, a mutrix whose columns are the contents of 
% conv. encoder at various clock cycles 
ul=u(l*k0:= 1:1); 





for i=1:n+1-2 
ul=[ul,u((i+i)*kO:—1-i#k0+1)]; 
end 


gu=reshape(ul tek0.n+1— 1); 
% determine the output 
output=reshape(remégeuu.2),1,n0e(I4n—1)); 
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ILLUSTRATIVE PROBLEM 


Mlustrative Problem 8.13 [Convolutional encoder} Determine the output of the convo- 
tutional encoder shown in Figure 8.17 when the information sequence is 





10011100110000111 





E- 


Here, the length of the information sequence is 17, which is not a muitiple of ky = 2; 
therefore, extra zero-padding will be done. In this case it is sufficient to add one 0, which 
gives a length of 18. Thus, we have the following information sequence 

100t11001100001110 


Now, since we have 
001010 
G=/0 00000 
1009000 


we obtain no = 3 and L = 4 (this is also obvious from Figure 8.17). The length of the 
output sequence is, therefore, 


(B44 x3=36 
The zero-padding required to make sure that the encoder starts from the all-O state and 
returns to the all-0 state adds (Z — 1)ko 0’s to the beginning and end of the input sequence. 
Therefore, the sequence under study becomes 
000000100111001!00001110000000 
Using the function cnv_encd.m, the output sequence is found to be 
OCOOOLTOLILIL0O1IOL11IOOIIOIOOIOONLILLL 


The MATLAB script to solve this problem is given below. 





kO=2; 
=(001010010000000110000004); 
inpu={1 0011100110000111); 


output=cny_encd(g,k0,input); 
SSS 


Representation of Convolutional Codes 


We have seen that a convolutional code can be represented either by the structure of the 
encoder or G, the generator matrix. We have also seen that a convolutional encoder can be 
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represented as a finite-state machine and, therefore, can be described by a state transition 
diagram representing the finite-state machine. A more widely used method for represen- 
tation of convolutional codes is in terms of their trellis diagram. A trellis diagram is a 
State transition diagram plotted versus time, Therefore, a trellis diagram is a sequence of 
2(4—Dko states, shown as dots, for each clock cycle and branches corresponding to transi- 
tions between these states. 

Consider the convolutional code with ko = 1, no = 2, and L = 3 shown in Figure 8.18. 
Obviously, this code can be represented by a finite-state machine with four states corre- 
sponding to different possible contents of the first two elements of the shift register, namely, 
00,01, 10, and 11. Let us represent these four states by the letters a, b, c, and d, respectively. 
In order to draw the trellis diagram for this code, we have to draw four dots corresponding 
to each state for each clock cycle and then connect them according to various transitions 
that can take place between states, The trellis diagram for this code is shown in Figure 8.19. 


kg =! 























Figure 8.19: The trellis diagram for the convolutional code shown in Figure 8.18. 


As we can see in Figure 8.19, on the time axis, which corresponds to clock cycles, 
the four states are denoted by black dots, and the transitions between States are indicated 
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by branches connecting these dots. On each branch connecting two states, two binary 
symbols indicate the encoder output corresponding to that transition. Also note that we 
always start from the all-O state (state a), move through the trellis following the branches 
corresponding to the given input sequence, and return to the all-O state. Therefore codewords 
of a convolutional code correspond to paths through the corresponding trellis, starting at 
the all-Q state and returning to the all-O state, 

The number of states in the trellis increases exponentially with the constraint length of 
the convolutional code. For example, for the convolutional encoder shown in Figure 8.17, 
the number of states is 2° = 64; therefore, the structure of the trellis is much more complex. 


The Transfer Function of a Convolutional Code 


For each convolutional code the transfer function gives information about the various paths 
through the trellis that start from the all-O state and return to this state for the first time. 
According to the coding convention described before, any codeword of a convolutional 
encoder corresponds to a path through the trellis that starts from the all-O state and returns 
to the all-O state. As we will see Jater, the transfer function of a convolutional code plays 
a major role in bounding the error probability of the code. To obtain the transfer function 
of a convolutional code, we split the all-O state into two states, one denoting the starting 
state and one denoting the first return to the all-O state, All the other states are denoted as 
in-between states. Corresponding to each branch connecting two states, a function of the 
form D” NË J is defined, where œ denotes the number of L's in the output bit sequence and 
£ is the number of 1's in the corresponding input sequence for that branch. The transfer 
function of the convolutional code is then the transfer function of the flow graph between 
the starting all-O state and the final all-O state and is denoted by 7(D, N, J). Each term 
of T(D, N, J) corresponds to a path through the trellis starting from the all-O state and 
ending at the all-O state. The exponent of J indicates the number of branches spanned by 
that path, the exponent of D shows the number of 1’s in the codeword corresponding to that 
path (or equivalently the Hamming distance of the codeword with the all-0 codeword), and 
the exponent of N indicates the number of 1’s in the input information sequence. Since 
T(D, N, J) indicates the properties of all paths through the trellis starting from the all-0 
path and returning to it for the first time, then, in deriving it, any se!f-loop at the all-0 state 
is ignored. To obtain the transfer function of the convolutional code, we can use all rules 
that can be used to obtain the transfer function of a flow graph. For more details on deriving 
the transfer function of a convolutional code, see [1}. 

Following the rules for deriving the transfer function, it is easy to show that the transfer 
function of the code shown in Figure 8.18 is given by 


DN 
1-DNJ~DNIP 
which, when expanded, can be expressed as 


T(D, N, J) = DIN? + DÎÍN?J* + DINU + DINE ++ 


TID. NJ) = 


From the above expression for T(D, N, J), we can see that there exists one codeword 
with Hamming weight 5, two codewords with Hamming weight 6, etc. It also shows, for 
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example, that the codeword with Hamming weight 5 corresponds to an input sequence of 
Hamming weight 1 and length 3. The smallest power of D in the expansion of T(D, N, J) 
is called the free distance of the convolutional code and is denoted by diee- In this example 
dice = 5. 


Decoding of Convolutional Codes 


There exist many algorithms for decoding of convolutional codes. The Viterbi algorithm is 
probably the most widely used decoding method of convolutional codes. This algorithm is 
particularly interesting because it is a maximum-likelihood decoding algorithm, which— 
upon receiving the channel output—searches through the trellis to find the path that is 
most likely to have generated the received sequence. If hard-decision decoding is used, 
this algorithm finds the path that is at the minimum Hamming distance from the received 
sequence, and if soft-decision decoding is employed, the Viterbi algorithm finds the path 
that is at the minimum Euclidean distance from the received sequence. 

In hard-decision decoding of convolutional codes, we want to choose a path through the 
trellis whose codeword, denoted by c, is at minimum Hamming distance from the quantized 
received sequence y. In hard-decision decoding the channel is binary memoryless (the fact 
that the channel is memoryless follows from the fact that the channel noise is assumed to be 
white). Since the desired path starts from the ail-O state and returns back to the all-O state, 
we assume that this path spans a total of m branches, and since each branch corresponds 
to no bits of the encoder output, the total number of bits in c and y is mno. We denote the 
sequence of bits corresponding to the ith branch by c; and y; respectively, where | <i < m 
and each c; and y; is of length no. The Hamming distance between c and y is, therefore, 


de, y) = J dle yo) (8.3.33) 





In soft-decision decoding we have a similar situation, with three differences: 


1. Instead of y we are dealing directly with the vector r, the vector output of the optimal 
{matched filter type or correfator type) digital demodulator. 


2. Instead of the binary 0, | sequence c, we are dealing with the corresponding sequence 
c with 
ais VE, fej =1 
d -VE, ifaj=0 
forl<i<smadl<sj<n. 


3. Instead of Hamming distance we are using Euclidean distance. This is a consequence 
of the fact that the channel under study is an additive white Gaussian noise channel. 


From the above we have 


diler) =) dale ri) (8.3.34) 


i=l 
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From Equations (8.3.33) and (8.3.34), we see that the generic form of the problem we 
have to solve is: Given a vector a to find a path through the trellis starting at the all-O state 
and ending at the all-O state such that some distance measure between a and a sequence b 
corresponding to that path is minimized. The important fact that makes this problem easy 
to solve is that the distance between a and & in both cases of interest can be written as the 
sum of distances corresponding to individual branches of the path. This is casily observe+ 
from (8.3.33) and (8.3.34). 

Now let us assume that we are dealing with a convolutional code with ko = 1. This 
means that there are only two branches entering each state in the trellis. If the optimal path 
at a certain point passes through state S, there are two paths that connect the previous states 
Sı and Sz to this state (see Figure 8.20) 


> Ios 
Pa 

. . 

. è : 


Figure 8.20: Justification of the Viterbi algorithm. 


If we want to see which one of these two branches is a good candidate to minimize 
the overall distance, we have to add the overall (minimum) metrics at states Sı and Sz to 
the metrics of the branches connecting these two states to the state S. Then obviously the 
branch that has the minimum total metric accumulation up to state S is a candidate to be 
considered for the state after the state S. This branch is called a survivor at state S, and the 
other branch is simply not a suitable candidate and is defeted. Now, after the survivor at 
state $ is determined, we also save the minimum metric up to this state, and we can move 
to the next state. This procedure is continued until we reach the all-0 state at the end of the 
trellis, For cases where ko > t, the only difference is that at each stage we have to choose 
one survivor path from among 2 branches leading to state $. 

The above procedure can be summarized in the following algorithm, known as the 
Viterbi algorithm. 


1, Parse the received sequence into m subsequences each of length rio . 


2. Draw a trellis of depth m for the code under study. For the last L — | stages of the 
trellis, draw only paths corresponding to the all-0 input sequences. (This is done 
because we know that the input sequence has been padded with ko(L — 1) 0's). 


3. Set/ = 1 and set the metric of the initial afl-O state equal to 0. 


4. Find the distance of the /th subsequence of the received sequence to all branches 
connecting /th-stage states to the (J + 1)st-stage states of the trellis. 
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w 


- Add these distances to the metrics of the /th-stage states to obtain the metric candidates 
for the (f+ 1)st-stage states. For each state of the (i+ l)st-stage, there are 2*0 candidate 
metrics, each corresponding to one branch ending at that state. 


6. For each state at the (J + L)st-stage, choose the minimum of the candidate metrics 
and label the branch corresponding to this minimum value as the survivor, and assign 
the minimum of the metric candidates as the metrics of the (l + L)st-stage states. 





7. Ifd = m, go to the next step; otherwise. increase / by 1 and go to step 4. 


8. Starting with the all-O state at the (m + 1)st stage, go back through the trellis along the 
Survivors to reach the initial all-O state. This path is the optimal path, and the input- 
bit sequence corresponding to that is the maximum-likelihood decoded information 
sequence. To obtain the best guess about the input-bit sequence, remove the last 
ko(L — 1) 0's trom this sequence. 


As we can see from the above algorithm, the decoding delay and the amount of memory 
required for decoding a long information sequence is unacceptable. The decoding cannot be 
started until the whole sequence (which in the case of convolutional codes can be very long) 
is received, and the total surviving paths have to be stored. In practice a suboptimat solution 
that does not cause these problems is desirable. On such an approach, which is referred to 
as path memory truncation, is that the decoder at each stage searches only 6 stages back 
in the trellis and not to the start of the trellis. With this approach at the (6 + 1)st stage, 
the decoder makes a decision on the input bits corresponding to the first stage of the trellis 
(the first kp bits), and future received bits do not change this decision. This means that the 
decoding delay wilt be koô bits, and it is required to keep the surviving paths corresponding 
to the last 5 stages. Computer simulations have shown that if 6 > 5L, the degradation in 
performance due to path memory truncation is negligible. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 8.14 [Viterbi decoding] Let us assume that in hard-decision decod- 
ing, the quantized received sequence is 





y = 01 101111010001 


The convolutional code is the one given in Figure 8.18. Find the maximum-likelihood 
information sequence and the number of errors. 


fm SOLUTION J 


‘The code is a (2, 1) code with L = 3. The length of the received sequence y is 14. This 
means that m = 7, and we have to draw a trellis of depth 7. Also note that since the input 
information sequence is padded with kg(Z — 1) = 2 zeros, for the final two stages of the 
trellis we will draw only the branches corresponding to all-0 inputs. This also means that 
the actual length of the input sequence is 5, which, after padding with two O's, has increased 
to 7. The trellis diagram for this case is shown in Figure 8.21. 

The parsed received sequence y is also shown in this figure. Note that in drawing the 
trellis in the last two stages, we have considered only the zero inputs to the encoder (notice 
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Received 
sequence 








Figure 8.21; The trellis diagram for Viterbi decoding of the sequence (01101111010001). 


that in the final two stages, there exist no dashed lines corresponding to 1 inputs). Now the 
metric of the initial all-O state is set to 0 and the metrics of the next stage are computed. In 
this step there is only one branch entering each state; therefore, there is no comparison, and 
the metrics (which are the Hamming distances between that part of the received sequence 
and the branches of the trellis) are added to the metric of the previous state. In the next stage 
there exists no comparison either. In the fourth stage, for the first time we have two branches 
entering each state. This means that a comparison has to be made here, and survivors are 
to be chosen. From the two branches that enter each state, one that corresponds to the least 
total accumulated metric remains as a survivor, and the other branches are deleted (marked 
by a smal! circle on the trellis). If at any stage two paths result in the same metric, each one 
of them can be a survivor. Such cases have been marked by a question mark in the trellis 
diagram. The procedure is continued to the final all-0 state of the trellis; then, starting from 
that state we move along the surviving paths to the initial all-O state. This path, which is 
denoted by a heavy path through the trellis, is the optimal path, The input-bit sequence 
corresponding to this path is 1100000, where the last two O's are not information bits but 
were added to return the encoder to the all-0 state. Therefore, the information sequence 
is 11000. The corresponding codeword for the selected path is 11101011000000, which 
is at Hamming distance 4 from the received sequence. All other paths through the trellis 
correspond to codewords that are at greater Hamming distance from the received sequence. 

For soft-decision decoding a similar procedure is followed, with squared Euclidean 
distances substituted for Hamming distances. 

The MATLAB function viterbi.m given below employs the Viterbi algorithm to de- 
code a channel output. This algorithm can be used both for soft-decision and hard- 
decision decoding of convolutional codes. The separate file metric.m defines the metric 
used in the decoding process. For hard-decision decoding this metric is the Hamming 
distance, and for soft-decision decoding it is the Euclidean distance. For cases where 
the channel output is quantized, the metric is usually the negative of the log-likelihood, 
~ log p(channel output | channel input). A number of short m-files called by viterbi.m are 
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also given below. 


e 


function [decoder-output,survivor-state cumulated merric}=viterbi(G,k,channelowput) 
GVITERBI The Viterbi decoder for convolutional codes 
[decoder.output,survivor_state, cumulated metric} =viterbi(G.k,channel output) 
G is a n x Lk matrix each row of which 

determines the connections from the shift register 10 the 

n-th ouput of the code, kin is the rate of the code. 
surviverstate is a matrix showing the optimal path through 

the trellis. The metric is given in a separate function metric(x.y) 
and can be specified to accomodate hard and soft decision. 

This algorithm minimizes the metric rather than maximizing 

the likelihood. 








SRKAKLARKFR 


nesize(G,1); 
% check the sizes 
if rem(size(G.2),k) “=0 
ermor(' Size of G and k do nor agree’) 
end 
if rem(size(channel_output.2),n) “=O 
ermor( ‘channel output not of the right size’) 
end 
Lesize(G.2}/k; 
number_of_states=2“{{L—1)*k); 
% generate state transition matrix, output matrix, and input matrix 
for j=0:number_of-states—1 
for 
(next_state,memory contents ]=axt_stat(j.L.k); 
input(j+4 next_state+1)=1: 
branch_output=rem(memory_contentseG* , 2} ; 
nextstate(j+1.l+1)}=next_state; 
output(j+4.1+1}=bin2deci(branch_output); 
end 
end 
state_metric=zeros(number_of_states.2); 
depth_of-trellis=length(channel_output)/n; 
channel_output_matrix=reshape(channel_output.n,depth .of trellis); 
survivor_state=zeros(number_of states,depth_of_trellis+1); 
% start decoding of non-iail channel outpuis 
for :depth-of-trellis-L+1 
flag=zeros(1,number-of-states); 
ifi <= L 
step=27 {L —i)*k); 
else 
step=1; 
end 
for j=0:step:number_of_states~1 
for 1=0:2*k—1 
branch_metric=0; 
Dinary-output=deci2bin(output(j+1,1+1),n); 











for N=1:n 
branch..metric=branch_metric+metric(channel_output_matrix(iLi),binary..output(1l)); 
end 


if((statemetric(nextstate(j+1,141)+1,2) > state_metric(j+1,1)... 
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+branch metric) | lag(nextstare(j+ 11+ 1)+1)=20) 
state metric(nextstate(j+1,1+1)+1,2) = state metric(j+1,1)+branch.metric; 
survivor_state(nextstate(j+1l+1}+1,i+1)=j: 
flag(nextstate(j+11+1)+1}=1; 
end 
end 
end 
state- metric=state_metric(:,2:~ 1:1); 
end 
% surt decoding of the tail channel-ouiputs 
for isdepthof-tecllis—L+2:depth_of trellis 
flag=zeros(1,number_of_states), 
last-stop=number_of_states /{2 *((i—depth of uellis+L—2)#k)); 
for j=O:last_stop—1 
branch_metric=0; 
binary output=deci2bin(output()+1, 1,0); 
for W=1in 
branch_metric=branch. metric +metric(channel _ourput_matrix(II,i).binary-output(3}): 
end 
iF((state.metric(nextstate(j+1,1)+1,2) > state_metric(j+1.1) 
+branch.metric) | flag(nextstace(j+1,1)+1)==0) 
state -metric(nextstate(j+1,1}+1,2) = state_metric(j+1,1)+branch_metric; 
Survivor _state(nextstate(j+1,1)+1.i+1)=y; 
flag(nextstate(j+1,1)+1}=1; 
end 
end 
state .metric=state_metric(:.2:— 1:1), 
end 
% generate the decoder output fram the optimal path 
state sequence=zeros( 1 depth_of_trellis+1): 
state_sequence(1,depth_of_trellis}=survivor_state( 1 ,depth_of_trellis+1): 
for i=1-depth_of trellis 
state_sequence( 1 depth_of_trellis—i+1}=survivor-state((state_sequence( 1,depth_of_wellist2-i). .. 
+1),depth_of_trellis—i+2): 
end 
decodeder_output_matrix=zeros(k,depth_of_treltis—L+1); 
for i=t:depth_of trellis—L+1 
decoutput_deci=input(state_sequence(1 i)+1 state_sequence(1.i+1)+1): 
dec_output_bin=deci2bin(dec_output_deci,k); 
decoder _output_matrix(: i)=dec.output_bin(k:~1:1)* ; i 
end i 
decoder-output=teshape(decoder_output_matrix, 1,k»(depth-of-treilis-L+1)); 
cumulated_metric=state_metric( 1,1); 


al» — 


function distance=metric(x,y) 
if x==y 
distance=0; 
else 
distance=1; 
end 
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ani» 


function [next_state, memory .contents}=nxt_stat(current_state, input,L,k) 
binary _state=deci2bin(current_state,kx(L—1)); 
binary_input=deci2bin(input,k); 
next_state_binary=(binary_ input, binary-state(1:(L—2)+k)}; 
next_state=bin2deci(next_state binary); 
memory_contents=[binary_input,binary-state]; 


-en 


function y=bin2deci{x) 

















Istength(x); 
y=(l-1:-4:0); 
y=2.^y; 
ysxey'; 








— airs 


function y=deci2bin{x,|) 
y = zeros(1,l); 

t i 
while x>=0 & i<=l 
ylij}=rem{x,2); 
-yli))/2; 


sie; 








end 
y=y(t-1: 


ILLUSTRATIVE BLEM 


Illustrative Problem 8.15 Repeat illustrative Problem 8.14 using the MATLAB function 
viterbi.m. 


E- 


It is enough to use the m-file viterbi.m with the following inputs 


tO) 
c=Í; l il 
k=l 
channeloutput=(0 1 | O t 1 1101000 1J 





x 











which results in decoder_output=[1 1 0 0 OJ] and an accumulated metric of 4. 


Error Probability Bounds for Convolutional Codes 


Finding bounds on the error performance of convolutional codes is different from the method 
used to find error bounds for block codes because here we are dealing with sequences of 
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very large length; since the free distance of these codes is usually small, some errors 
will eventually occur. The number of errors is a random variable that depends both on 
the channel characteristics (signal-to-noise ratio in soft-decision decoding and crossover 
probability in hard-decision decoding) and the length of the input sequence. The longer 
the input sequence, the higher the probability of making errors. Therefore, it makes sense 
to normalize the number of bit errors to the length of the input sequence. A measure that 
is usually adopted for comparing the performance of convolutional codes is the expected 
number of bits received in error per input bit. To find a bound on the average number of bits 
in error for each input bit, we first derive a bound on the average number of bits in error for 
each input sequence of length k. To determine this, let us assume that the all-O sequence is 
transmitted? and, up to stage / in the decoding, there has been no error. Now k information 
bits enter the encoder and result in moving to the next stage in the trellis. We are interested 
in finding a bound on the expected number of errors that can occur due to this input block 
of length k. Since we are assuming that up to stage / there has been no error, then, up to 
this stage the all-O path through the trellis has the minimum metric. Now, moving to the 
next stage (stage (l + |)st) it is possible that another path through the trellis will have a 
metric less than the all-O path and therefore cause errors. If this happens, we must have 
a path through the trellis that merges with the all-O path for the first time at the (f + !)st 
stage and has a metric less than the all-0 path. Such an event is called the first error event 
and the corresponding probability is called the first error event probability. This situation 
is depicted in Figure 8.22. 








Figure 8.22: The path corresponding to the first error event. 


Our first step is bounding the first error event probability. Let P2(d) denote the prob- 
ability that a path through the trellis that is at Hamming distance d from the all-O path is 
the survivor at the (? + 1)st stage. Since d is larger than dfree, we can bound the first error 


2 Because of the linearity of convolutional codes, we can, without loss of generality, make this assumption. 
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event probability by 


~ 
Pes J, au Pod) 
d=dires 


where on the right-hand side we have included all paths through the trellis that merge with 
the all-O path at the (/-+1)st stage. P2(d) denotes the error probability for a path at Hamming 
distance d from the all-0 path and a denotes the number of paths at Hamming distance d 
trom the all-O path. The value of P;(d) depends on whether soft- or hard-decision decoding 
is employed. 

For soft-decision decoding, if antipodal signaling (binary PSK) is used, we have 


Pi(d)=Q (+) 


and, therefore, 


co A 
P< J ug 2Red 


d'Eire 


Using the well-known upper bound on the Q function 


2 


Qix) < a 


we obtain 


Now, noting that 





D=e 
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where 


T(D) = T(D. N, J)lyosat 
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This is a bound on the first error event probability. To find a bound on the average number 
of bits in error for k input bits, P,(k), we note that each path through the trellis causes a 
certain number of input bits to be decoded erroneously. For a general DNS) J8® in 
the expansion of T(D, N, J), there is a total of f (d) nonzero input bits. This means that 
the average number of input bits in error can be obtained by multiplying the probabifity 
of choosing each path by the total number of input errors that would result if that path 
were chosen. Hence, the average number of bits in error, in the soft-decision case, can be 
bounded by 


Ga 


Èk) < JO ay f(d) Prd) 


dadipee 
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3 
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2 
Sy DL asf (dye eE (8.3.35) 
d=tlnee 
If we define 
T(D,N) = T(D, N, J) yet 
>æ 
= J apni 
d=dine 
we have 
ANAD, N) = 
paella = J assay! (8.3.36) 
oe N=l dadie 


Therefore, using (8.3.35) and (8.3.36), we obtain 


2 1 87,(D, N) 
Po(k) < IN 





N=1.D=e7ôcEpi No 


To obtain the average number of bits in error for each input bit, we have to divide this bound 
by k. Thus, the final result is 





p - L 210.) 
EZR ON Yoi baktim 


For hard-decision decoding, the basic procedure follows the above derivation. The only 
difference is the bound on P;(d). It can be shown (see (1]) that P2(d) can be bounded by 


Pr(d) < (4p(l — p)?” 


3 Here we are somewhat sloppy in notation. The power of N is not strictly a function of d, but we are denoting 
it by f(d). This however does not have any effect on the final result. 
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Using this result, it is straightforward to show that in hard-decision decoding, the probability 
of error is upper-bounded as 


= _ 1 8%(D,N) 
b Sz — 
ko ON ONDA 


A comparison of hard-decision decoding and soft-decision decoding for convolutional codes 
shows that here, as in the case for linear block codes, soft-decision decoding outperforms 


hard-decision decoding by a margin of roughly 2 dB in additive white Gaussian noise 
channels. 
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Problems 


8.1 Write a MATLAB script to plot the capacity of a binary symmetric channel with 
crossover probability p as a function of p for O < p < 1. For what value of p is the 
capacity minimized, and what is the minimum value? 


8.2. A binary nonsymmetric channel is characterized by the conditional probabilities p(0 | 
1) = 0.2 and p(1 | 0) = 0.4, Plot the mutual information {(X; Y) between the input and 
the output of this channel as a function of p = P(X = 1). For what value of p is the mutual 
information maximized, and what is the value of this maximum? 


8.3 A Z-channel is a binary input. binary output channel, with input and output alphabets 
X = Y = {0,1} and characterized by p(O | I) = e and p(l | 0) = 0. Plot F(X: Y) as 
a function of p = P(X = 1) fore = 0.0.1, 0.2, 0.3, 0.4, 0.5, 0.7, 0.9, 1. Determine the 
capacity of the channel in cach case. 


8.4 A binary input, ternary output channel is characterized by the input and output alphabets 
X = {0, land ¥ ={0, 1, 2}, and transition probabilities p(0 | 0) = 0.05, p(1 | 0) = 0.2. 
pO | 1) = 0.1, p0 į 1) = 0.1. Plot 7(X; Y} as a function of p = P(X = 1), and 
determine the channel capacity. 


8.5 A ternary input, binary output channel is characterized by the input and output alphabets 
X = (0, 1, 2}and ¥ = {0, 1}, and transition probabilities p(O | 0) = 0.05, p(1 | D = 0.2, 
pO | 2) = 0.1, pl | Ly = 0.1. Plot £(X; Y) as a function of pi = P(X = 1) and 
pz = P(X = 2), and determine the channel capacity. 


8.6 Plot the capacity of a binary symmetric channel that employs binary orthogonal signal- 
ing as a function of Ka 


8.7 Repeat Illustrative Problem 8.3, but assume that the two transmitted signals are equal- 
energy and orthogonal. How do your results differ from those obtained in Illustrative 
Problem 8.3? 


8.8 Compare the plots of the capacity for hard decision and soft decision when orthogonal 
signals are employed. Compare these results with those obtained for antipodal signals. 


8.9 Plot the capacity of a binary symmetric channe! that uses orthogonal signals, as a 
function of Ze Do this once with the assumption of coherent detection and once with the 
assumption of noncoherent detection. Show the two plots on the same figure and compare 
the results, 


8.10 Write a MATLAB script that generates the generator matrix of a Hamming code in 
the systematic form for any given m. 


8.3. Channel Coding 389 
8.11 Repeat Illustrative Problem 8.10 using orthogonal signaling with coherent and non- 
coherent detection. Plot the results on the same figure. 


8.12 Use Monte Carlo simulation to plot the error probability versus yp in Illustrative 
Problem 8.10. 


8.13 Repeat Illustrative Problem 8.12, but instead of orthogonal and antipodal signaling 
compare the performance of coherent and noncoherent demodulation of orthogonal signals 
under soft-decision decoding. 


8.14 Use Monte Carlo simulation to plot the error probability versus yp in Illustrative 
Problem 8.12. 


8.15 Use MATLAB to find the output of the convolutional encoder shown in Figure 8.18 
when the input sequence is 


110010191010010111101011111010 


8.16 A convolutional code is described by 


1 
0 
G=]; 
I 


reer 


kit 
1 0 
01 
1 t 


a. Ifk = 1, determine the output of the encoder when the input sequence is 


11001010101001011 1101011411010 


b. Repeat part a with k = 2. 


8.17 In Problem 8.15, after obtaining the output of the encoder change the first 6 bits of 
the received sequence and decode the result using Viterbi decoding. Compare the decoder 
output with the transmitted sequence. How many errors have occurred? Repeat the problem 
once by changing the last 6 bits in the received sequence and once by changing the first 3 
bits and the last 3 bits and compare the results. In ail cases the Hamming metric is used. 


8.18 Generate an equiprobable binary sequence of length 1000. Encode the sequence using 
the convolutional code shown in Figure 8.18. Generate four random binary error sequences, 
each of length 2000, with probability of 1 equal to 0.01, 0.05, 0.1, and 0.2, respectively. 
Add (modulo 2) each of these error sequences to the encoded sequence and use the Viterbi 
algorithm to decode the result. In each case compare the decoded sequence with the encoder 
input and determine the bit-error rate. 


8.19 Use Monte Carlo simulation to plot the bit-error rate versus yp in a convolutional 
encoder using the code shown in Figure 8.18 . Assume that the modulation scheme is 
binary antipodal, once with hard-decision and once with soft-decision decoding. Let yp 
be in the interval from 3 to 9 dB, and choose the length of your information sequence 
appropriately. Compare your results with the theoretical bounds. 
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8.20 The encoder of Figure 8.18 is used to transmit information over a channel with two 
inputs and three outputs. The outputs are denoted by 0, 1, and 2. This is the case where the 
output of a Gaussian channel is quantized to three levels. The conditional probabilities of 
the channel are given by p(0 | 0) = p(1 | 1) = 0.9, p(2|0) = p(2| 1) = 0.09. Use the 
Viterbi algorithm to decode the received sequence 


020201 102021 120022201 101010202201 11112 


Chapter 9 


Spread Spectrum 
Communication Systems 


9.1 Preview 


Spread spectrum signals for digital communications were originally developed and used for 
military communications either (1) to provide resistance to hostile jamming, (2) to hide the 
signal by transmitting it at !ow power and, thus, making it difficult for an unintended listener 
to detect its presence in noise, or (3) to make it possible for multiple users to communicate 
through the same channel. Today, however, spread spectrum signals are being used to 
provide reliable communications in a variety of commercial applications, including mobile 
vehicular communications and interoffice wireless communications. 

The basic elements of a spread spectrum digital communication system are illustrated 
in Figure 9.1. We observe that the channe? encoder and decoder and the modulator and 
demodulator are the basic elements of a conventional digital communication system. In 
addition to these elements, a spread spectrum system employs two identical pseudorandom 
sequence generators, one of which interfaces with the modulator at the transmitting end 
and the second of which interfaces with the demodulator at the receiving end. These two 
generators produce a pseudorandom or pseudonoise (PN) binary-valued sequence that is 
used to spread the transmitted signal in frequency at the modulator and to despread the 
received signal at the demodulator, 

Time synchronization of the PN sequence generated at the receiver with the PN sequence 
contained in the received signai is required to properly despread the received spread spec- 
trum signal. In a practical system, synchronization is established prior to the transmission 
of information by transmitting a fixed PN bit pattern that is designed so that the receiver will 
detect it with high probability in the presence of interference. After time synchronization 
of the PN sequence generators is established, the transmission of information commences. 
In the data mode, the communication system usually tracks the timing of the incoming 
received signal and keeps the PN sequence generator in synchronism. 

In this chapter we consider two basic types of spread spectrum signals for digital com- 
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Figure 9.1: Model of spread spectrum digital communication system. 


munications, namely, direct sequence (DS) spread spectrum and frequency-hopped (FH) 
spread spectrum. 

Two types of digital modulation are considered in conjunction with spread spectrum, 
namely, PSK and FSK. PSK modulation is generally used with DS spread spectrum and is 
appropriate for applications where phase coherence between the transmitted signal and the 
received signal can be maintained over a time interval that spans several symbol (or bit) 
intervals. On the other hand, FSK modulation is commonly used with FH spread spectrum 
and is appropriate in applications where phase coherence of the carrier cannot be maintained 
due to time variations in the transmission characteristics of the communications channel. 


9.2 Direct-Sequence Spread Spectrum Systems 


Let us consider the transmission of a binary information sequence by means of binary PSK. 

The information rate is R bits per second, and the bit intervat is 7, = 1/R seconds. The 

available channel bandwidth is B, hertz, where Be >> R. At the modulator the bandwidth 

of the information signal is expanded to W = B, hertz by shifting the phase of the carrier 

pseudorandomly at a rate of W times per second according to the pattern of the PN generator. 

The resulting modulated signal is called a direct-sequence (DS) spread spectrum signal. 
The information-bearing baseband signal is denoted as v(t) and is expressed as 


EJ 
v(t) = J angri- nT) (9.2.1) 
n=- 
where {an = +1, -œ < n < oo} and gr (t) is a rectangular pulse of duration Tp. This 
signal is multiplied by the signal from the PN sequence generator, which may be expressed 
as 


o0 


c(t) = J capt- nT.) (9.2.2) 


n==00 
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where {cn} represents the binary PN code sequence of +1's and p(t) is a rectangular pulse 
of duration To, as illustrated in Figure 9.2. This multiplication operation serves to spread the 
bandwidth of the information-bearing signal (whose bandwidth is approximately R hertz) 
into the wider bandwidth occupied by PN generator signal c(t) (whose bandwidth is approx- 
imately 1/T,). The spectrum spreading is illustrated in Figure 9.3, which shows, in simple 
terms using rectangular spectra, the convolution of the two spectra, the narrow spectrum 
corresponding to the information-bearing signal and the wide spectrum corresponding to 
the signal from the PN generator. 
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Figure 9.2: Generation of a DS spread spectrum signal. (a) PN signal. (b) Data signal. (c) 
Product signal. 


The product signal u(t)c(#), also illustrated in Figure 9.2, is used to amplitude-modulate 
the carrier A, cos 27 ft and, thus, to generate the DSB-SC signal 


u(t) = Acu(t)c(t) cos 27 fet (9.2.3) 
Since u(t)c(t) = +1 for any ¢, it follows that the carrier-modulated transmitted signal may 


also be expressed as 


u(t) = A, cos [27 fet + O(t)) (9.2.4) 
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Figure 9.3: Convolution of spectra of the (a) data signal with the (b) PN code signal. 
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where 9(1) = 0 when v{t)e(T) = l and 8{r) = x when u(t)e(t) = —1. Therefore, the 
transmitted signal is a binary PSK signal whose phase varies at the rate 1/7... 

The rectangular pulse p(t) is usually called a chip, and its time duration T, is called the 
chip interval. The reciprocal 1/T, is called the chip rate and corresponds (approximately) 
to the bandwidth W of the transmitted signal. The ratio of the bit interval 7} to the chip 
interval T, is usually selected to be an integer in practical spread spectrum systems. We 
denote this ratio as 


Th 
hiat 9.2.5 
cee ( ) 
Hence, L, is the number of chips of the PN code sequence per information bit. Another 
interpretation is that Le represents the number of possible 180° phase transitions in the 
transmitted signal during the bit interval Th. 


9.2.1 Signal Demodulation 


The demodulation of the signal is performed as illustrated in Figure 9.4. The received signal 
is first multiplied by a replica of the waveform c(t) generated by the PN code sequence 
generator at the receiver, which is synchronized to the PN code in the received signal. This 
operation is called (spectrum) despreading, since the effect of multiplication by c(t) at the 
receiver is to undo the spreading operation at the transmitter. Thus, we have 


Acu(t)c?(t) cos 2 fet = Apu(t) cos 2m fot (9.2.6) 


since c(t) = 1 for all £. The resulting signal A,v(t) cos 27 fet occupies a bandwidth 
(approximately) of R hertz, which is the bandwidth of the information-bearing signat. 
Therefore, the demodulator for the despread signal is simply the conventional cross corre- 
lator or matched filter that was described in Chapters 5 and 7. Since the demodulator has a 
bandwidth that is identical to the bandwidth of the despread signal, the only additive noise 
that corrupts the signal at the demodulator is the noise that falls within the information 
bandwidth of the received signal. 


Effects of Despreading on a Narrowband Interference 


It is interesting to investigate the effect of an interfering signal on the demodulation of the 
desired information-bearing signal. Suppose that the received signal is 


r(t) = Acv(t)e(t) cos 2a fot + i(t) (9.2.7) 


where i(t) denotes the interference. The despreading operation at the receiver yields 


r(t)e(t) = Ault) cos 2m fet + i(t)e(t) (9.2.8) 
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Figure 9.4: Demodulation of DS spread spectrum signa! 


The effect of multiplying the interference i(r) with c(t) is to spread the bandwidth of i(t) 
to W hertz. 
As an example, let us consider a sinusotdal interfering signal of the form 


i(t) = Ay cos 2x fyt (9.2.9) 


where fy is a frequency within the bandwidth of the transmitted signal. Its multiplication 
with c(t) results in a wideband interference with power-spectral density Jo = Ps/W, 
where Py = Aj /2 is the average power of the interference. Since the desired signal is 
demodulated by a matched filter (or correlator) that has a bandwidth R, the total power in 
the interference at the output of the demodulator is 


PR Py; Py Ps 
W WIR Tolle Le 





(9.2.10) 


Therefore, the power in the interfering signal is reduced by an amount equal to the 
bandwidth expansion factor W/R. The factor W/R = 7,/T- = Le is called the processing 
gain of the spread spectrum system. The reduction in interference power is the basic 
reason for using spread spectrum signals to transmit digital information over channels with 
interference. 

In summary, the PN code sequence is used at the transmitter to spread the information- 
bearing signal into a wide bandwidth for transmission over the channel. By multiplying 
the received signal with a synchronized replica of the PN code signal, the desired signal is 
despread back to a narrow bandwidth, whereas any interference signals are spread over a 
wide bandwidth. The net effect is a reduction in the interference power by the factor W/R, 
which is the processing gain of the spread spectrum system. 

The PN code sequence {cp} is assumed to be known only to the intended receiver. Any 
other receiver that does not have knowledge of the PN code sequence cannot demodulate 
the signal. Consequently, the use of a PN code sequence provides a degree of privacy (or 
security) that is not possible to achieve with conventional modulation. The primary cost for 
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this security and performance gain against interference is an increase in channel bandwidth 
utilization and in the complexity of the communication system. 


9.2.2 Probability of Error 


In an AWGN channel, the probability of error for a DS spread spectrum system employing 
binary PSK is identical to the probability of error for conventional (unspread) binary PSK; 


ie., 
2Ep 
Pr=Q ( To ) (9.2.11) 


On the other hand, if the interference is the sinusoidal signal given by (9.2.9) with power 
P;, the probability of error is (approximately) 


n=o( z) -efi = | (9.2.12) 


Thus, the interference power is reduced by the factor of the spread spectrum signal band- 
width W. In this case, we have ignored the AWGN, which is assumed to be negligible; 
i.e., No & P/W. If we account for the AWGN in the channel, the error probability is 


expressed as 
2£; 
VE a2] A aa 
No + Ps /W 


=o( ea ) (9.2.13) 








The Jamming Margin 


When the interference signal is a jamming signal, we may express fe as 


En _ PsTp Ps/R _ W/R 


ho  P;/W P/W  Py/Ps 


Now, suppose we specify a required £ / Jp to achieve a desired performance, Then, using 
a logarithmic scale, we may express (9.2.14) as 





(9.2.14) 


Py wW Ep 
10 log PeT 10log = — 10log (#) 


w 
GOE om 
Psjaa \R/a \/a 
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The ratio (Py /Ps)ug is called the jamming margin. This is the relative power advantage 
that a jammer may have without disrupting the communication system. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 9.1 Suppose that we require an £,/Jy = 10 dB to achieve reliable 
communication with binary PSK. Determine the processing gain that is necessary to provide 
a jamming margin of 20 dB. 


Sep —$$______________ 


By using (9.2.15) we find that the processing gain (W/R)yg = 30 dB: i.e, W/R = 
Le = 1000. This means that with W/R = 1000, the average jamming power at the receiver 
may be 100 times the power Ps of the desired signal, and we would still maintain reliable 
communication. 








Performance of Coded Spread Spectrum Signals 


As shown in Chapter 8, when the transmitted information is coded by a binary linear (block 
or convolutional) code, the SNR at the output of a sott-decision decoder is increased by the 
coding gain, defined as 


H 
Coding gain = Rodinin 


(9.2.16) 


where R, is the code rate and dha isthe minimum Hamming distance of the code. Therefore, 
the effect of the coding is to increase the jamming margin by the coding gain. Thus (9.2.15) 


may be modified as 
Ba” (z) (3) 
a4 pay pee + (CG)a — | Z (9.2.17) 
ie aB Rj s J Jag 


9.2.3 Two Applications of DS Spread Spectrum Signals 


In this subsection we briefly describe the use of DS spread spectrum signais in two appli- 
cations. First, we consider an application in which the signal is transmitted at very low 
power, so that a listener would encounter great difficulty in trying to detect the presence of 
the signal. A second application is multiple-access radio communications. 


Low-Detectability Signal Transmission 


In this application the information-bearing signal is transmitted at a very low power level 
relative to the background channel noise and thermal noise that is generated in the front end 
of a receiver. If the DS spread spectrum signal occupies a bandwidth W and the power- 
spectral density of the additive noise is No watts/hertz, the average noise power in the 
bandwidth W is Py = W Nọ. 

The average received signal power at the intended receiver is Pg. If we wish to hide 
the presence of the signal from receivers that are in the vicinity of the intended receiver, 
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the signal is transmitted at a power level such that Pr/ Pw & 1. The intended receiver can 
recover the weak information-bearing signal from the background noise with the aid of the 
processing gain and the coding gain. However, any other receiver that has no knowledge 
of the PN code sequence is unable to take advantage of the processing gain and the coding 
gain. Consequently, the presence of the information-bearing signal is difficult to detect, 
We say that the transmitted signal has a low probability of being intercepted (LPI), and it 
is called an LPI signal. 

The probability of error given in Section 9.2.2 applies as well to the demodulation and 
decoding of LPI signals at the intended receiver, 

ILLUSTRATIVE PROBLE! 


Mlustrative Problem 9.2 A DS spread spectrum signal is to be designed such that the 
power ratio at the intended receiver is Pg/ Py = 0.01 for an AWGN channe!. The desired 
value of £;/No is for acceptable performance. Let us determine the minimum value of the 
Processing gain required to achieve an £}/No of 10, 


ą—C 


We may write £,/No as 


En PRT PRL Te Pr Pp 
= = = c= : 2.18 
No No No (7 L Py Le 22:18) 








Since Z,/No = 10 and Pp/Py = 1072, it follows that the necessary processing gain is 
Le = 1000. 


Code Division Muitipte Access 


The enhancement in performance obtained from a DS spread spectrum signal through the 
processing gain and the coding gain can be used to enable many DS spread spectrum signals 
to occupy the same channel bandwidth, provided that each signal has its own pseudorandom 
(signature) sequence. Thus it is possible to have several users transmit messages simulta- 
neously over the same channel bandwidth. This type of digital communication, in which 
each transmitter/receiver user pair has its own distinct signature code for transmitting over 
acommon channel bandwidth, is called code division multiple access (CDMA). 

In digital cellular communications, a base station transmits signals to Nu mobile re- 
ceivers using Nu orthogonal PN sequences, one for each intended receiver, These Nu 
signals are perfectly synchronized at transmission, so that they arrive at each mobile re- 
ceiver in synchronism. Consequently, due to the orthogonality of the Nuy PN sequences, 
each intended receiver can demodulate its own signal without interference from the other 
transmitted signals that share the same bandwidth. However, this type of synchronism 
cannot be maintained in the signals transmitted from the mobile transmitters to the base 
station (the uplink, or reverse link). In the demodulation of each DS spread spectrum signal 
at the base station, the signals from the other simultaneous users of the channel appear as 
additive interference. Let us determine the number of simultaneous signals that can be ac- 
commodated in a CDMA system. We assume that all signals have identical average powers 
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at the base station. In many practical systems the received signal's power level from cach 
user is monitored at the base station, and power control is exercised over ail simultaneous 
users by use of a control channe! that instructs the users on whether to increase or decrease 
their power levels, With such power control. if there are Ny simultaneous users, the desired 
signal-to-noise interference power ratio at a given receiver is 


PS ES ee al (9.2.19) 
Py (Ne -WPs Nast 
From this relation we can determine the number of users that can be accommodated simul- 
taneously. 

In determining the maximum number of simultaneous users of the channel, we implicitly 
assumed that the pscudorandom code sequences used by the various users are orthogonal and 
that the interference Irom other users adds on a power basis only. However, orthogonality of 
the pseudorandom sequences among the N,, users generally is difficult to achieve, especially 
if Nu is large. In fact, the design of a large set of pseudorandom sequences with good 
correlation properties is an important problem that has received considerable attention in 
the technical literature. We briefly treat this problem-in Section 9.3. 


ILLUSTRATIVE PROBLEM 


Illustrative Problem 9.3 Suppose that the desired level of performance for a user in a 
CDMA system is achieved when £p/ Jo = 10. Let us determine the maximum number of 
simultaneous users that can be accommodated in the CDMA system if the bandwidth-to- 
bit-rate ratio is 100 and the coding gain is 6 dB. 


Em 


From the basic relationship given in (9.2.17), we have 


Bg” (a) (3) 
Æ) =(—) +(COs-(— 
(z 4B Ri sp {CMe Jo/ ap 


=20 +6- 10 = 16 dB 








Consequently, 
-Bs 
=F. 
and, hence, 
Ny = 41 users 
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ILLUSTRATIVE PRI 





LEM 





Illustrative Problem 9.4 The objective of this problem is to demonstrate the effectiveness 
of a DS spread spectrum signal in suppressing sinusoidal interference via Monte Carlo 
simulation. The block diagram of the system to be simulated is illustrated in Figure 9.5, 
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Figure 9.5: Model of DS spread spectrum system for Monte Carlo simulation. 





—E — 


A uniform random number generator (RNG) is used to generate a sequence of binary 
information symbols (+1). Each information bit is repeated Le times, where Le corresponds 
to the number of PN chips per information bit. The resulting sequence, which contains Le 
repetitions per bit, is multiplied by a PN sequence c() generated by another uniform RNG, 
To this product sequence we add white Gaussian noise with variance ¢? = No/2 and 
sinusoidal interference of the form 


i(n) = A sin wn 


where 0 < wo < x and the amplitude of the sinusoid is selected to satisfy A < Le. The 
demodulator performs the cross correlation with the PN sequence and sums (integrates) the 
blocks of Le signal samples that constitute each information bit. The output of the summer 
is fed to the detector. which compares this signal with the threshold of zero and decides 
on whether the transmitted bit is +1 or —1. The error counter counts the number of errors 
made by the detector. The results of the Monte Carlo simulation are shown in Figure 9.6 
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for three different values of the amplitude of the sinusoidal interference with Le = 20. 
Also shown in Figure 9.6 is the measured error rate when the sinusoidal interference is 
removed. The variance of the additive noise was kept fixed in these simulations and the 
level of the desired signal was scaled to achieve the desired SNR for each simulation run. 
The MATLAB scripts for the simulation program is given below. 


aia» 


% MATLAB script for Illustrative Problem 4, Chapter 9. 
echo on 








% number of chips per bit 

% amplitude of the first sinusoidal interference 

% amplitude of the second sinusoidal interference 

% amplitude uf the third sinusoidal interference 

% fourth cuse: no interference 

% frequency of the sinusoidal interference in radians 





SNRindB=0:2:30; 
for i=1:length(SNRindB), 
To measured error rates 





smiderr..prb | (i}=s8_-Pe94(SNRindB(i),Lc,A 1,w0); 
smid_err_prb2(i. ~Pe94(SNRindB(i),Le,A2,.w0); 
smid_err_prb3(i)=ss_Pe94(SNRindB(i).Lc,A3,w0); 





end; 
SNRindB4=0:1:8; 
for i=1:length(SNRindB4), 
% measured error rate when there is no interference 
smld.err_prb4(i)=ss_Pe94(SNRindB4(i),Le,A4,w0); 
end; 
% plotting commands follow 


m 


function [p]=ss Pe94isnrin-dB, Le, A. w0) 











% {p]=ss_Pe9dsnrin.dB, Le, A, wO) 

% SS_PE92 finds the measured error rate. The function 

% that returns the meusured probability of error for the given value of 

% the snr.indB, Le, A und w0. 

snr=10° (snr-in-dB/10); 

sgma=1; % noise standard deviation is fixed 

Eb=2esgma”2asnr; % signal level required to achieve the given 
% signal-to-noise ratio 

E_chip=Eb/Le; % energy per chip 

N=10000; % number of bits transmitted 


% The generation of the data, noise, interference, decoding process, and error 
% counting is performed ull together in order to decrease the run time of the 
% program. This is accomplished by avoiding very large sized vectors 
num-of_err=0; 
for i=1:N, 
% generate the next duta bit 
temp=rand; 
if (temp<0.5), 
data=—1; 
else 
data=1; 
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end; 
% repeat it Le times, i.e. divide it into chips 
for j=1:Le, 
repeated_data(j}=data: 
end: 
To PN sequence for the duration of the bit is generated next 
for j=1:Le, 
temp=rand; 
if (temp<0.5), 
pnseqtj)=—1; 
else 
pr_seq(j)=1; 
end: 
end; 
% the transmitted signal is 
trans_sig=sqrt(E_chip)«repeated_data *pn.seq: 
% AWGN with variance syma*2 
noise=sgmasrandn(1,Lc); 
% interference 
a=(i—1)eLe+tiiaLe; 
interference=A «sin(wOen), 
% received signal 
rec_sig=trans_sig+noise+interference: 
% determine the decision variable from the received signal 
temp=rec_sig.*pn_seq, 
decision_variable=sum(temp); 
% making decision 
if (decision_variable <0), 
decision=—1, 
eise 
decision=1; 
end; 
% if it is an error, increment the error counter 
if (decision”=data), 
num_of_err=num_of_err+1; 
end; 
end; 
% then the measured error probability is 
p=num_of_err/N; 





9.3 Generation of PN Sequences 


A pseudorandom, or PN, sequence is a code sequence of L's and O's whose autocorrelation 
has properties similar to those of white noise. In this section, we briefly describe the con- 
struction of some PN sequences and their autocorrelation and cross correlation properties. 

By far, the most widely known binary PN code sequences are the maximum-length 
shift-register sequences. A maximum-length shift-register sequence, or m-sequence for 
short, has a length L = 2” — 1 bits and is generated by an m-stage shift register with 
linear feedback, as illustrated in Figure 9.7. The sequence is periodic with period L. Each 
period has a sequence of 2"~! ones and 2"~! — 1 zeros. Table 9.1 lists the shift register 
connections for generating maximum-length sequences. 
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Figure 9.6: Error-rate performance of the system from the Monte Carto simulation. 


In DS spread spectrum applications, the binary sequence with elements {0, 1} is mapped 
into a corresponding binary sequence with elements {—1, 1}. We shall call the equivalent 
sequence {c} with elements {— 1, 1} a bipolar sequence. 

An important characteristic of a periodic PN sequence is its autocorrelation function, 
which is usually defined in terms of the bipolar sequences {cn} as 


i 
Rem) = ocncrtms = OSM SL-1 (9.3.1) 


n=l 


where L is the period of the sequence. Since the sequence {cn} is periodic with period L, 
the autocorrelation sequence {R-(m)} is also periodic with period L. 

Ideally, a PN sequence should have an autocorrelation function that has correlation 
properties similar to white noise. That is, the ideal autocorrelation sequence for {cq} is 
R-(0) = Land Re(m) = O for 1 < m < L — 1. In the case of m-sequences, the 
autocorrelation sequence is 
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Figure 9.7: General m-stage shift register with linear feedback. 


Table 9.1: Shift-register connections for generating ML sequences. 














Stages Connected Stages Connected Stages Connected 
m | to Modulo-2 Adder |} m_| to Modulo-2 Adder || m | to Modulo-2 Adder || 
2 1,2 13 | 1, 10, 11, 13 24 | 1, £8, 23, 24 
3 1,3 14 | 1,5,9, 14 2! 1, 23 
4 1,4 15 } 1,15 26 | 1,21, 25, 26 
5 L4 16 | 1,5, 14, 16 27 | 1, 23, 26, 27 
6 1,6 17] 115 28 | 1,26 
7 1,7 18 | 1,12 29 | 1,28 
8 1,5,6,7 19 | 1, 15, 18, 19 30 | 1, 8, 29, 30 
9 1,6 20 | 1,18 31 | 1,29 
10 | 1,8 21 | 1,20 32 | 1, 11,31,32 
11 | 1,10 22 | 1,22 33:1) 1,21 
12 | 1,7,9, 12 23 | 1,19 34 | 1,8, 33, 34 
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Table 9.2: Peak cross correlations of m-sequences and Gold sequences. 


















































m-sequences Gold sequences 
m | b= 2"7! || Number | Rmax | Rma / RO) || Rma | Rmax/ RO) 
[3 7 2 5 071 5 071 
1 4 15 2 9 0.60 9 0.60 j 
5 31 6 1l 0.35 9 0.29 
6 63 6 23 0.36 17 0.27 
J 127 18 41 0.32 17 0.13 
8 255 16 95 0.37 33 0.13 
9 Sil 48 H3 0.22 j 33 0.06 
10 1023 60 383 0.37 65 0.06 
i} 2047 176 | 287 0.14 65 0.03 
12 4095 144 | 1407 0.34 || 129 0.03 
Rima (ee ee (9.3.2) 


-hL ism<l-l 


For long m-sequences, the size of the off-peak values of R,(m) relative to the peak value 
Re(0)—i.e., the ratio Re(m)}/ Re(0) = —1/L—is small and, from a practical viewpoint, 
inconsequential. Therefore, m-sequences are very close to ideal PN sequences when viewed 
in terms of their autocorrelation function. 

In some applications the cross correlation properties of PN sequences are as important 
as the autocorrelation properties. For example, in CDMA each user is assigned a particular 
PN sequence. Ideally, the PN sequences among users should be mutually orthogonal so that 
the level of interference experienced by one user from transmissions of other users is zero. 
However, the PN sequences used in practice by different users exhibit some correlation. 

To be specitic, let us consider the class of m-sequences. It is known that the periodic 
cross correlation function between a pair of m-sequences of the same period can have 
relatively large peaks. Table 9.2 lists the peak magnitude Rmax for the periodic cross 
correlation between pairs of m-sequences for 3 < m < 12. Also listed in Table 9.2 is the 
number of m-sequences of length L = 2” — 1 for 3 < m < 12. We observe that the 
number of m-sequences of the length L increases rapidly with m. We also observe that, 
for most sequences, the peak magnitude Rinax of the cross-correlation function is a large 
percentage of the peak value of the autocorrelation function. Consequently, m-sequences 
are not suitable for COMA communication systems. Although it is possible to select a 
small subset of m-sequences that have relatively smaller cross correlation peak values than 
Rmax, the number of sequences in the set is usually too small for CDMA applications. 


9.3. Generation of PN Sequences 407 


Methods for generating PN sequences with better periodic cross correlation properties 
than m-sequences have been developed by Goid [5],{6] and by Kasami [7]. Gold sequences 
are constructed by taking a pair of specially selected m-sequences, called Preferred m- 
sequences, and forming the modulo-2 sum of the two sequences for each of L cyclically 
shifted versions of one sequence relative to the other sequence. Thus L Gold sequences 
are generated as illustrated in Figure 9.8. For large L and m odd, the maximum value of 
the cross correlation function between any pair of Gold sequences is Rmax = /2L. For m 
even, Rinax = VL. 
































Gold seque: 
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Figure 9.8: Generation of Gold sequences of length 31. 





Kasami [7] described a method for constructing PN sequences by decimating an m- 
sequence. In Kasami’s method of construction, every Bre + 1)st bit of an m-sequence is 
selected. This method of construction yields a smaller set of PN sequences compared with 
Gold sequences, but their maximum cross correlation value is Rmax = VL. 

It is interesting to compare the peak value of the cross correlation function for Gold 
sequences and for Kasami sequences with a known lower bound for the maximum cross 
correlation between any pair of binary sequences of length L. Given a set of N sequences 
of period L, a lower bound on their maximum cross correlation is 





Rma > L (9.3.3) 


which, for large values of L and N is well approximated as Rmax > VL. Hence, we observe 
that Kasami sequences satisfy the lower bound and, hence, they are optimal. On the other 
hand, Gold sequences with m odd have Rmax = V2L. Hence, they are slightly suboptimal. 

Besides the well-known Gold sequences and Kasami sequences, there are other binary 
sequences that are appropriate for CDMA applications. The interested reader is referred to 
the papers by Scholtz [8], and Sarwate and Pursley (9). 
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ILLUSTRATIVE PROBLEM 


Illustrative Problem 9.5 Let us generate the L = 31 Gold sequences that result from 
taking the modulo-2 sum of the two shift-register outputs shown in Figure 9.8. 


-eD 


The MATLAB scripts for performing this computation is given below. The 31 sequences 
generated are shown in Table 9.3. The maximum value of the cross correlation for these 
sequences is Rmax = % 


Åm a e 


% MATLAB script for Hustrative Problem 5, Chapter 9 
echo on 
% first determine the maximul length shift register sequences 
% we'll take the initial shift register content us "00001". 
connections1=(1 0 t 0 0); 
connections2={1 1 1 0 1); 
sequence | =ss_mists(connections 1); 
sequence2=ss_mlsrs(connections2); 
% cyclically shift the second sequence and add it to the first one 
L=2"length(connections|)—1;; 
for shift-amount=0:L—1, 
temp=(sequence2(shift_amount+1:L) sequence 2(1:shift-amount)|; 
gold_seq(shift_amount+1,:)=(sequencel+temp) — floor({sequencel+temp)./2).«2; 
end, 
% find the max value uf the cross correlution for these sequences 
max_cross_corr=0; 























% equivalent sequences 
cl=2egotd_seq(i.:)~15 
c2=2egold_seq(j.)—1: 
for m=0:L—1, 

shifted_c2=[c2(m+1:L) ¢2(1:m)}; 
corr=abs(sum(cl.+shifted.c2)); 
if (corr> max cross_cort), 
max cross corr=cort: 
end; 
end; 
end; 
end: 
% note that max.cross.corr turns out ta be 9 in this example. 








a= 





function {seq}=ss-mtsrs( connections); 
% {seq}=ss-mlsrs{connections) 
SS-MLSRS generates the maximal length shift register sequence when the 


% shift register connections are given as input to the function. A “zero” 
% means not connected, whereas a “one” represents a connection. 
me=length(connections); 

L=2*m-1; % length uf the shift register sequence requested 
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registers={zeros(1,m—1) 1}; % initial register contents 
seq()=registers(m), % first element of the sequence 
for i=2:L, 

new_reg_cont(1)=connections( 1)¥seq(i—1); 

for j=2:m, 

new _reg_cont(j}=registers(j—1)+connections()sseq(i—1): 

end; 

registers=new_reg_cont: % current register contents 

seq(i)=registers(m): % the next element of the sequence 
end: 





9.4 Frequency-Hopped Spread Spectrum 


In frequency-hopped (FH) spread spectrum the available channel bandwidth W is subdi- 
vided into a large number of nonoverlapping frequency slots. In any signaling interval the 
transmitted signal occupies one or more of the available frequency slots. The selection 
of the frequency slot(s) in each signal interval is made pseudorandomly according to the 
output from a PN generator. 

A block diagram of the transmitter and receiver for a FH spread spectrum system is 
shown in Figure 9.9. The modulation is either binary or M-ary FSK (MFSK). For example, 
if binary FSK is employed, the modulator selects one of two frequencie., say, fo or fi, 
corresponding to the transmission ofa 0 fora 1. The resulting binary FSK signal is translated 
in frequency by an amount that is determined by the output sequence from a PN generator, 
which is used to select a frequency f, that is synthesized by the frequency synthesizer. This 
frequency-translated signal is transmitted over the channel. For example, by taking m bits 
from the PN generator, we may specify 2" — 1 possible carrier frequencies, Figure 9.10 
illustrates a FH signal pattern. 

At the receiver, there is an identical PN sequence generator, synchronized with the 
received signal, which is used to contro] the output of the frequency synthesizer. Thus, 
the pseudorandom frequency translation introduced at the transmitter is removed at the 
demodulator by mixing the synthesizer output with the received signal. The resultant 
signal is then demodulated by means of an FSK demodulator. A signal for maintaining 
synchronism of the PN sequence generator with the FH received signal is usually extracted 
from the received signal. 

Although binary PSK modulation generally yields better performance than binary FSK, 
it is difficult to maintain phase coherence in the synthesis of the frequencies used in the 
hopping pattern and, also, in the propagation of the signal over the channel as the signal 
is hopped from one frequency to another over a wide bandwidth. Consequently, FSK 
modulation with noncoherent demodulation is usually employed in FH spread spectrum 
systems. 

The frequency-hopping rate, denoted as Ra, may be selected to be either equal to the 
symbol rate, lower than the symbol rate, or higher than the symbol rate. If Ra is equal to or 
lower than the symbol rate, the FH system is called a slow-hopping system. If Ra is higher 
than the symbol rate, i.e., there are multiple hops per symbol, the FH system is called a 
fast-hopping system. We shall consider only a hopping rate equat to the symbol rate. 
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Table 9.3: Table of Gold sequences from Illustrative Problem 9.5. 














0111000010000110010010111100000 
0101101110001000001001000110001 
0000110110010100) 11110110010011 
| 1010000110101 1010100010110101T] 
i1111001110111£10001110001011110 
0100100100111000110000101001100 
0010100011110101001101101101001 
1110101101101110110F11100100011 
0110110001011001000011110110110 
0110001000110¢Ł10101011010011101 
0t111£1101110t001!1101001100t0T1 
01000111010}011}1011000001100114 
001101000010101001110010011111! 
1101001011010000010101110001111 
00011111001001000001t£1011101110 
1000010011001100100010000101101 
10110011000111011010001:10101010 
}101t10010}11111111101010100100 
DQOOODOTITITIIO11 01011 0010111000] 
LOTET10101110010000000010000001 | 
11000000011000001011000172110010 
00!1101001000101110100000010100 
110011100000111100010011 1011001 
00100110100110101001010010000I0 
TUL1O1T110110001100110101110101 
OLOLOLOILILO0O111100001100011010 
0001000101001011101111111000101 
[1001100000010011110011001111011 
| 1000101010100011001010100000110 
1010111111000010111001111111100 
1110010100000001011111000001000 


aA 








































































































9.4. Frequency-Hopped Spread Spectrum 


PN sequence Frequency 
generator synthesizer 


ne 



















Information FSK 


sequence Encoder Channel 







modulator 

















FSK 
PN sequence Frequency Time 
generator synthesizer synchronizer 














Figure 9.9: Block diagram of an HF spread spectrum system. 
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Figure 9.10: An example of an FH pattern. 
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9.4.1 Probability of Error for FH Signals 


Letus consider a FH system in which binary FSK is used to transmit the digital information. 
The hop rate is | hop per bit. The demodulation and detection is noncoherent. in an AWGN 
channel, the probability of error of such a system is 


P, = per iiss (9.4.1) 
The same result applies if the interference is a broadband signal or jammer with flat spectrum 
that covers the entire FH band of width W. In such a case, No is replaced by No + Jo, 
where Jo is the spectral density of the interference, 

As in the case of a DS spread spectrum system, we observe that £}, the energy per bit, 
can be expressed as Ep = PsT, = Ps/R, where Ps is the average signal power and R 
is the bit rate. Similarly, Jo = P;/W, where Py is the average power of the broadband 
interference and W is the available channel bandwidth. Therefore, assuming that Jo >> No, 
the SNR can be expressed as 


En _ W/R 
Jo  P;/Ps 





(9.4.2) 


where W/R is the processing gain and P,/Ps is the jamming margin for the FH spread 
spectrum signal. 

Slow FH spread spectrum systems are particularly vulnerable to a partial-band inter- 
ference that may result either from intentional jamming or in FH CDMA systems. To be 
specific, suppose that the partial-band interference is modeled as a zero-mean Gaussian 
random process with a flat power-spectral density over a fraction of the total bandwidth 
W and zero in the remainder of the frequency band. In the region or regions where the 
power-spectral density is nonzero, its value is S;(f) = Jo/a, where 0 < œ < 1. In other 
words, the interference average power Py is assumed to be constant, and œ is the fraction 
of the frequency band occupied by the interference. 

Suppose that the partial-band interference comes from a jammer that selects œ to opti- 
mize the effect on the communications system. In an uncoded slow-hopping system with 
binary FSK modulation and noncoherent detection, the transmitted frequencies are selected 
with uniform probability in the frequency band W. Consequently, the received signal will 
be jammed with probability œ, and it will not be jammed with probability 1 — œ. When 
it is jammed, the probability of error is 1/2 exp(—app/2), and when it is not jammed, the 
detection of the signal is assumed to be error-free, where pp = Ep/Jo. Therefore, the 
average probability of error is 


Pila) z exp (—app/2) 


2 
a aWw/R 

ae pick Bb 9.4. 
exp ( ‘Sl (9.4.3) 
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Figure 9.11 illustrates the error rate as a function of the SNR py for several values of œ. 
The jammer is assumed to optimize its strategy by selecting œ to maximize the probability 


of error. By differentiating P» (œ) and solving for the value of œ that maximizes Py(a), we 
find that the jammer’s best choice of a is 


tikes ee Pp 22 


L meh (9.4.4) 
The corresponding error probability for the worst-case partial-band jammer is 
e'/pp. h22 
Py = Leah, Pred (9.4.5) 





which is also shown in Figure 9.11. Whereas the error probability decreases exponentially 
for full-band jamming, as given by (9.4.3), the error probability for worst-case partial-band 
jamming decreases only inversely with £+ / Jo. 


Probability of bit error 











1s 
SNR/bit, dB 


Figure 9.11: Performance of binary FSK with partial-band interference. 
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ILLUSTRATIVE P 





LEM 


Mustrative Problem 9.6 Via Monte Carlo simulation, demonstrate the performance of an 
FH digital communication system that employs binary FSK: and is corrupted by worst-case 
partial-band interference. The block diagram of the system to be simulated is shown in 
Figure 9.12. 
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Figure 9.12: Model of a binary FSK system with partial-band interference for the Monte 
Carlo simulation. 





A uniform random number generator (RNG) is used to generate a binary information 
sequence, which is the input to the FSK modulator. The output of the FSK modulator is 
corrupted by additive Gaussian noise with probability œ, where 0 < œ < 1. A second 
uniform RNG is used to determine when the additive Gaussian noise corrupts the signal 
and when it does not. In the presence of noise, the input to the detector, assuming that a 0 
is transmitted, is 
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r= (VE cose +n.) + (VEssing +m) 


2 2 
ry = ny, +73, 


where @ represents the channel-phase shift and Nes Riss Mc, Nos represent the additive 
noise components. In the absence of noise, we have 


r=E£y. 12 =0 


and , hence, no errors occur at the detector. The variance of each of the noise components is 
a? = aJo/2, where œ is given by (9.4.4). For simplicity, we may set @ = 0 and normalize 
Jo by setting it equal to unity. Then, p; En/Jo = Ey. Since o? = Jo/2a anda = 2/ Pb. 
it follows that, in the presence of partial-band interference, o? = £,/4 anda = 2/Ep, 
where £p is constrained to £} > 2. Figure 9.13 illustrates the error rate that results from the 
Monte Carlo simulation. Also shown in the figure is the theoretical value of the probability 
of error given by (9.4.5). The MATLAB scripts for the simulation program are given below. 














% MATLAB script for Illustrative Problem 6, Chupter 9 


echo on 
rho_bI=0:5:35; % rhu in dB for the simulated error rate 
rhob2=0:0.1:35; % rho in dB for theoretical error rate computation 
for i=1:length(rho_bl). 

smld.err_prb<i)=ss_pe96(rho_b1(i)); % simulated error rate 
end: 


for i=1:length(cho-b2), 
temp=107 (rho_b2(i)/10): 


if (temp>2) 
theo_ert_cateti}= 1 /(exp(1}«temp); % theorencal error rate if rho>2 
else 
theo-err_rate(i}=(1/2)eexp(—temp/2):% thenretical error rate if rho<2 
end; 
end; 


% ploning command follow 


aii» 


function {p} = ss-Pe9%(rha.in-dB) 
% Ip}=ss_Pe96(rho in dB) 
% SSPE96 finds the measured error rate, The value of 











% signal per interference rario in dB is given as un 
% input to the function. 
tho=10°(tho.in.dB/10); 
Eb=rho; % energy per bit 
if (tho>2), 
alpha=2/rho; % optimal aipha if rho > 2 
else 
aipha=1; % optimal alpha if rho < 2 
end, 
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sgma=sqrt(1 /(2«alpha)). % noise standard deviation 
N=10000, T% number of bits transmitted 
% generation of the data sequence 
for i=1:N, 
temp=rand: 
if (temp<0.5) 
data(i)=1; 
else 
data(i)=0; 
end; 
end; 
% find the received signals 
for is 1:N, 
Jo the transmitted signal 
if (data(i}==0), 
rle(i)=sqr(Eb); 
rls(i)=0; 
r2c(i)=0; 
12s(i)=0; 
else 
rle(i)=0; 
F1s(i)=0; 
r2c(i)=sqrt(Eb); 
r2s(i)=0, 
end, 
[% the received signal is found by adding noise with probability alpha 
if (rand<alpha), 
Flc(i)=ric(i)+gngauss(sgma); 
cls(i=rls(i)+gngauss(sgma); 
r2c(i)=r2c(i)+gngauss(sgma): 
r2s(i)=12s(i)+gngauss(sgma); 
end; 
end; 
% make the decisions und count the number of errors made 
num.of.err=0; 
for i=1:N, 
tl=rle(i}* 2+risti)*2; % first decision variable 
r2=r2c(i)* 2+r2s(i)*2; % second decision variable 
% decision is made next 
“if (r1>02), 
decis=0; 
else 
decis=1; 
end; 
% increment the counter if this is an error 
if (decis"=data(i)), 
num_of_err=num_of_err+1; 
end; 
end; 
F measured bit error rate is then 
p=num-_of_ert/N; 
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Figure 9.13: Error-rate performance of FH binary FSK system with partial-band interference 
— Monte Carlo simulation. 


9.4.2 Use of Signal Diversity to Overcome Partial-Band Interference 


The performance of the FH system corrupted by partial-band interference as described in 
the previous section is very poor. For example, for the system to achieve an error probability 
of 1076, the SNR required at the detector is almost 60 dB in the presence of worst-case 
interference. By comparison, in the absence of partial-band interference, the SNR required 
in AWGN is about 10 dB. Consequently, the loss in SNR due to the presence of the partial- 
band interference is approximately 50 dB, which is excessively high. 

The way to reduce the effect of partial-band interference on the FH spread spectrum 
system is through signal diversity; i.e., the same information bit is transmitted on multiple 
frequency hops, and the signals from the multiple transmissions are weighed and combined 
together at the input to the detector. To be specific, suppose that each information bit is 
transmitted on two successive frequency hops. The resulting system is called a dual diversity 
system. In this case, assuming that a 0 is transmitted, the two inputs to the combiner are 
either both corrupted by interference, or one of the two transmitted signals is corrupted by 
interference, or neither of the two transmitted signals is corrupted by interference. 

The combiner is assumed to know the level of the interference and, thus, forms the 
combined decision variables, 


x = wiry + wiz 
y = wira + wraz (9.4.6) 
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where r11, 721 are the two outputs of the square-law device for the first transmitted signal 
and r12, r22 are the outputs of the square-law device from the second transmitted signal. 
The weights w; and w3 are set to !/a?, where o? is the variance of the additive noise plus 
interference. Hence, when g? is large, as would be the case when interference is present, 
the weight placed on the received signal is small. On the other hand, when o? is small, as 
would be the case when there is no interference, the weight placed on the received signal is 
large. Thus, the combiner de-emphasizes the received signal components that are corrupted 
by interference. 

The two components x and y from the combiner are fed to the detector, which decides 
in favor of the larger signal component. 

The performance of the FH signal with dual diversity is now dominated by the case in 
which both signal transmissions are corrupted by interference. However, the probability of 
this event is proportional to œ?, which is significantly smaller than œ. As a consequence, 
the probability of error for the worst-case partial-band interference has the form 


P2) = 5, Ph > 2 (9.4.7) 


where K3 is a constant and pp = £p/Jo. In this case, the probability of error for dual 
diversity decreases inversely as the square of the SNR. In other words, an increase in SNR 
by a factor of 10 (10 dB) results in a decrease of the error probability by a factor of 100. 
Consequently, an error probability of 1076 can be achieved with an SNR of about 30 dB 
with dual diversity, compared to 60 dB (1000 times larger) for no diversity. 

More generally, if each information bit is transmitted on D frequency hops, where D is 
the order of diversity, the probability of error has the form 


K 
P,(D) = 75 py >2 (9.4.8) 
b 


where Kp is a constant. 

Since signal diversity as described above is a trivial form of coding (repetition coding), 

it is not surprising to observe that instead of repeating the transmission of each information 

bit D times, we may use a code with a minimum Hamming distance equal to D and soft- 
decision decoding of the outputs from the square-law devices. 

ILLUSTRA E PROBLEM 








Mlustrative Problem 9.7 Repeat the Monte Carlo simulation for the FH system considered 
in Illustrative Problem 9.6, but now employ dual diversity. 


-em 


In the absence of interference, the weight used in the combiner is set to w = 10, 
which corresponds to g? = 0.1, a value that may be typical of the level of the additive 
Gaussian noise. On the other hand, when interference is present, the weight is set to 
w = l/a? = 2/£, where £ is constrained to be £ > 4. The SNR per hop is £, and the 
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total energy per bit in the two hops is £, = 2£. Therefore, the error probability is plotted 
as a function of £}/Jo. The results of the Monte Carlo simulation are illustrated in Figure 
9.14. The MATLAB scripts for the simulation program is given below. 








% MATLAB scripit for Hlustrative Problem 7, Chapter 9. 





echo on 
tho. 24; % rho in dB 
for i=1-lengthtrho_b), 
smld_ert_prb(i=ss_Pe9 (rho. bli); % simulated error rate 


end; 
% Ploning commands follow 


-D 


function [p]=ssPe97(rho in iB) 
% {p}=ssPe97(rho_indB) 
% SS_PE97 finds the measured error rate. The value of 
% signal per interference ratio in dB is given as an input 
% to the function. 
tho=107(rho_in.dB/10); 
Eb=rho; 
E=Eb/2; 
% the optimal value of alpha 
if (rho>2), 
alpha=2/rho; 
else 
alpha=1; 
end; 
F the variance of the additive noise 
if (E>1), 
sgma=sqrt(E/2); 
else 
sgma=sqr(t/2); 
end; 








% energy per information bit 
% energy per symbol transmitted 


N=10000: % number of bits transmitted 
% generation of the data sequence 
for is1:N, 
temp=rand; 
if (temp<0.5) 
data@)=1; 
else 
data(i)=0; 
end; 
end; 
% find the transmitted signals 
for i=1:N, 











qrt(E); tel 2cli)=sqrt(E): 


yn 
g 





te21s()=0,  tr22sći, 
else 
wlici)=0; trl 2c(i)=0; 
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=0; 
w22e(iy=sqr(E); 
=0; 
end; 
end; 


Co find the received signals, make the decisions, and count the number of errors made 
num.of-err=0, 
for i=1:.N, 
% determine if there is jamming 
if (rand<alpha), 
jamming |=1; % jamming present un the second transmission 
else 
jamming!=0; % jamming not present on the first transmission 
end; 
if (rand <alpha), 
jamming2=1; % jamming present on the second transmission 
else 
jamming2=0; % jamming noi present on the second transmission 
end; 
% the the received signals are 
if Gammingl==1} 








riicetrl Le(i)+gngauss(sgmay; rl Issu l Lsfi) +gngauss(sgma); 
‘ic=te2ci)+gngauss(sgma), 2 Ls=tr? Ls(i)+gngauss(sgma); 
else 

rllestelleti); rl Is=tel Isti); 

Alest2c(i), — Asstr2Asti): 

end; 





if Gamming2==1) 
ri2c=tri2c(+gngauss(sgma); 112: 
r22c=tr22cti)+gngauss(sgma), r22 
else 
rl2estrl2cli),  rl2s=tr!2sți); 
r22e=tr22cti), F22s=tr22s(i); 
end: 
% compute the decision variables, first the weights 
if Gammingl==1), 
wl=t /sgma”2, 
else 


12sti+gngauss(sgma); 
22sti) +gngauss(sgma): 











w2=1/sgma* 
etse 

w2=10; 
end; 
% the intermediate decision variables are computed as follows 
thi=rlle"2+rl is” 
rl2=cl2c*2+r12s* 
r2j=r2lc^2+r215^2; 
122=122¢*24122s ° 2; 
% finally, the resulting decision variables x and y are computed 
xsw lard l+w2«r12; 

=w Lard] +w24022; 
% make ihe decision 
if (x>y), 
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decis=0; 
else 
decis=1; 
end: 
% increment the counter if this is an error 
if (decis"=data(i)), 
num_of-err=num_of_err+1: 
end: 
end: 
% the measured bit-error rate ix then 
p=num_ofert/N; 
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Figure 9.14: Error-rate performance of FH dual diversity binary FSK with partial-band 
interference — Monte Carlo simulation. 
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Problems 


9.1 Write a MATLAB program to perform a Monte Carto simutation of a DS spread spec- 
trum system that transmits the information via binary PSK through an AWGN channel. 
Assume that the processing gain is 10. Plot a graph of the measured error rate versus the 
SNR and, thus, demonstrate that there is no performance gain from the spread spectrum 
signal. 


9.2 Write a MATLAB program to perform a Monte Carlo simulation of a DS Spread spec- 
trum system that operates in an LPI mode. The processing gain is 20 (13 dB) and the desired 
power signal-to-noise ratio Ps/ Py at the receiver prior to despreading the signal is —5 dB 
or smaller. Plot the measured error rate as a function of the SNR. 


9.3 Repeat the Monte Carlo simulation described in Illustrative Problem 9.4 fora processing 
gain of 10 and plot the measured error rate. 


9.4 Write a MATLAB program that implements an m = 12-stage maximal-length shift 
register and generate three periods of the sequence. Compute and graph the periodic auto- 
correlation function of the equivalent bipolar sequence given by (9.3.1). 


9.5 Write a MATLAB program that implements an m = 3-stage and an m = 4-stage 
maximal-length shift register and form the modulo-2 sum of their output sequences. Is the 
resulting sequence periodic? If so, what is the period of the sequence? Compute and sketch 
the autocorrelation sequence of the resulting (bipolar) sequence using (9.3.1). 


9.6 Write a MATLAB program to compute the autocorrelation sequence of the L = 31 
Gold sequences that were generated in Illustrative Problem 9.5. 


9.7 An FH binary orthogonal FSK system employs an m = 7-state shift register to generate 
a periodic maximal-length sequence of length L = 127. Each stage of the shift register 
selects one of N = 127 nonoverlapping frequency bands in the hopping pattern. Write a 
MATLAB program that simulates the selection of the center frequency and the generation 
of the two frequencies in each of the N = 127 frequency bands. Show the frequency 
selection pattern for the first 10 bit intervals. 


9.8 Write a Monte Carlo program to simulate a FH digital communication system that 
employs binary FSK with noncoherent (square-law) detection. The system is corrupted by 
partial-band interference with spectral density Jo/a, where a = 0.1. The interference is 
spectrally flat over the frequency band 0 < a < 0.1, Plot the measured error rate for this 
system versus the SNR Ep/Jo. 


9.9 Repeat the Monte Carlo simulation in Illustrative Problem 9.7 when the weight used 
at the combiner in the absence of interference is set to w = 100 and with interference 
the weight is w = 1/o* = 2/£, where the signal energy is £ > 4. Plot the measured 
error rate from the Monte Carlo simulation for this dual diversity system and compare this 
performance with that obtained in IMustrative Problem 9.7. 
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lowpass equivalent of a signal, 36 

lowpass random processes, 69 


M-ary orthogonal signaling, 20% 
error probability, 205 
M-ary PAM, 196 
error probability, 197 
magnitude spectrum, 4 
Markov process, 55 
matched filter, 169, 170 
maximum-likelinood sequence detection 
(MLSD), 275 
modulation 
AM, 79 
carrier amplitude, 281 
carrier-frequency, 313 
carrier-phase, 287 
conventional AM, 89 
DSB-AM, 80 
FM, 116 
SSB-AM, 96 
modulation index, 118 
multidimensional signals, 187 
mutual information, 344 


nonlinear equalizer, 271 
Nyquist frequency, 244 
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Nyquist rate, 23 


on-off signaling, 182 
error probability, 184 


Parseval’s theorem, 19 
partial response signaling, 251 
precoding, 253 
PCM, 146 
mu-law nonlinearity, 152 
nonuniform, 152 
SQNR, 147 
uniform, 146 
phase spectrum, 4 
phase-locked loop (PLL), 326 
phase-shift keying (PSK), 288 
PLL, 326 
PN sequences, 403 
power spectral density 
for periodic signats, 33 
PAM signal, 223 
power-type signal, 32 
preset equalizer, 257 
processing gain, 396 
PSK, 288 
error probability, 293 
Pulse-code modulation, 146 


QAM, 304 
demodulation, 306 
error probability, 309 
quadrature amplitude modulation 
(QAM), 304 
quadrature component, 36 
quantization, 138 
scalar, 138 
uniform, 139 
vector, 138 


raised-cosine signal, 244 
random processes 
bandlimited, 69 
bandpass, 71 
cyclostationary, 222 
filtering, 63 
Gauss-Markov process, 55 
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properties, $1 
lowpass, 69 
Markov process, 55 
power spectrum, 57 
white processes, 57 
random variables 
Gaussian, 49 
covariance matrix, 51 
generation, 45 
Rayleigh, 49 
uniform, 46 
Rayleigh’s theorem, 19 
roll-off factor, 244 


sampling theorem, 23 
Nyquist rate, 23 
Shannon limit, 322 
signal diversity, 417 
signum function, 19 
simple repetition code, 355 
sinc function, 5 
spectrum 
discrete, 4 
magnitude, 4, 21 
of a signal, 21 
phase, 4, 21 
spread spectrum systems, 392 
direct sequence, 392 
frequency-hopped, 409 
SSB-AM, 96 
LSSB-AM, 96 
SNR, 96 
spectrum, 96 
USSB-AM, 96 
stochastic gradient algorithm, 268 
synchronization 
carrier, 326 
clock, 332 


transfer function, 12 
trellis diagram, 375 


VCO, 327 
Viterbi algorithm, 377, 378 


voltage-controlied oscillator (VCO), 327 


zero-forcing equalizer, 259 


